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ABSTRACT 

This paper originated as part of the early phases of 
internal planning within the National Institute for Education (NIE). 
A status study was conducted of the existing system of educational 
research and development (R&D) which (1) provided a framework of 
information as an initial context for framing policy and (2) examined 
a major mandate^ given to NIE in its creating legislation, to build 
an effective educational R&D system. Three parallel courses of action 
were followed to gather information on the status of the R&D system: 
(1) data collection; (2) development of a larger framework of 
analysis to guide subsequent work (the present paper); and (3) design 
of a plan for an administrative unit of NIE charged with monitoring 
the development of the national R&D system and sponsoring studies 
related to its operation • The discussion here, centered on the 
framework development, divides into three major sections^ The first 
section presents a framework of discourse on modelling. A specialized 
vocabulary is introduced and basic concepts of monitoring are 
presented. A "bridge" is provided between the simplified discussion 
of modelling presented here and a number of models not discussed. TLe 
second section presents a set of general criteria for tracing 
boundaries of educational R&D systems and expands the concept of 
educational R&D beyond usual acceptation. The third section deals^ 
with a specific framework for modelling the R&D system and reporting 
on it that is sufficiently comprehensive to accommodate most current 
models of R&D and the great majority of data available from either 
large-scale sampling at the national level or research on portions of 
the system. A concluding section relates the framework to NIE 
concerns. Appended is the author's view of how R&D fits into the 
world of knowledge. (HM) 
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Foreword 



The paper presented here owes much to the assistance and encouragement 
of numerous persons both at the Ontario Institute for Studies in Education 
and at the National Institute for Education. At the NIE particular 
mention should be made of the contributions of Dr. Ward Mason and the 
assistance of Ms. Nancy Holt and Mr. Donald Fischer. 

The content of the paper remains, as the saying goes, the responsibility 
of the authoro It constitutes an attempt by a practising administrator 
of educational research and development (R&D) to think about the underlying 
theory of his field of work. The intended public is a very narrow range 
of persons concerned with the methodology of defining and monitoring R&D 
sy stems o The focus is educational R&D, but there are numerous generalizations 
to other areas, especially where the objective of R&D involves social change. 

Given the narrow range of the paper's intended public, tho author 
considers the following to be its major weaknesses and strengths: 

Weaknesses 

lo The content of Section I is almost purely didactic, and, there 
fore, irrelevant for most of the intended audienceo Its justi- 
fication is the possibility that, together with the numerous 
examples of Section II, the section might assist readers with 
other interests to assimilate the outlook and content of the 
more substantive sections of the paper© 
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2. The examples given in Section II for many concepts are both 
superfluous and superficial for the informed reader. The 
reason for their presence has just been stated. 

3. The paper provides few footnotes or references. Given the many 
areas touched upon, the author feels that such additional 
pedantic apparaLus would add nothing for the informed reader 
and, for the occ-asional person new to any area, would be of 
less utility than a-^few minutes in a reference library. 

Strengths 

1, The methodological discussion may have some utility for 

workers in the field who may use it as one point of comparisor. 
for their own efforts, for the following reasons: 

(a) The discussion of boundary definition in Section II 
includes a brief summary of almost all criteria 
currently used. Obviously these criteria are some- 
times mutually contradictory, a reason which explains 
why they are seldom found discussed in one place. (The 
author is unav;are, doubtless through unf amiliarity with 
relevant writings, of any other such formulation of 
alternatives ) « 

(b) The discussion of ^*regulators" is probably original in 
the context of monitoring R^D sy:stcias of any kind© 

(c) Extending the concept of educational R&D to task-oriented 
r^nd informal education and to information procassing 
systems, as done in Section II, is relatively new in the 



iii. 

literature. The discussion of related system boundary 

criteria is probably originalo 
2o The proposal for a reporting framework is apparently well 

grounded in current needs of NIE (and other institutions engaged 
in educational R&D). The specific framework proposed is cer- 
tainly not sacrosanct and is subject to restatement and revi- 
sion. However, the author feels strongly that, whatever 
framework is used for reporting, its clarity and comprehen- 
siveness as a ''bird^s eye view" of the whole enterprise should 
not be any less than that in the proposed framework. Such a 
framework, once adopted, should be maintained consistently over 
time as a point of reference in all documents on the R&D system 
published by NIE. The practical utility of such a procedure is 
enormous: provided the formulation ol the model is in "neutral" 
terms. This means that it should be^ acceptable both to the 
educational "practitioner" and to the R&D "doer". Communication 
failures are at the heart of many policy failures of the recent 
past. 

3. T!:»e model of the R&D infrastructure for education is an adapta- 
tion from other fields, though the formulation includes original 
elements. 

4o The proposal for adopting, in addition to other modes of inquiry, 
an econor ic perspective for studies of the R&D system is not 
entirely new, though it is more comprehensive than other existing 



proposals and discusses certain methodological problems not 
previously found in the literature. 
The value of uhese judgements is left to the appreciation of the 
reader o 



Stacy Churchill 
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MODELLING A NATIONAL EDUCATIONAL R&D SYSTEM 



A CONCEPTUAL FRAMEWORK 
by Stacy Churchill 

Introduction 

A. BACKGROUND 

Tnis paper originated as part of the early phases of internal planning 
within the recently created National Institute for Education. The Planning 
and Policy Analysis Unit identified the need to begin an immediate status study 
of the existing system of educational research and development which would 
serve -a double purpose: to provide a framework of infonration as an initial 
context for framing policy recommendations and to begin examination of a major 
mandate given to NIL in the legislation which created it: 

"... to build an effective educational research and development 
system." (Education Arrendments of 1972, Title III, Sec. 405. 
(a) (2), p. 99). 

Information on the status of the R&D system was necessary, therefore, as a 
guide to formation of policy on developing it and, over the longer term, as 
a measure of the effectiveness of those policiec. Three parallel courses of 
action were chosen: 

a) doing a rapid survey of existing statistical sources, mainly 
secondary, to document recent trends; given the need to act 
rapidly, the data collection framework was patterned after, 
the major previous study. Educational Research and Development 
in the United States , prepared in 1959 by the National Center 
for Educational Research and Development (NCERD 1959); 

b) developing a larger framework of analysis to guide subsequent 
work (the present paper being a first step in this task) \ and 
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c) designing a plan for a pernvanent adininistrative unit of NIE 
charged with monitoring on a permanent basis the development 
of the national educational I^&l^ system and sponsoring studies 
related to its operation « 
A survey of the current literature on educational research and 
development in the United States reveals that almost all studieo have been 
undrrtaken to serve purposes narrower than those laid down in the legislative 
irandate for NIE. None seemed to be comprehensive enough to serve as a long- 
tem planning and research framework; indeed, it was clear that no single 
model or model type would suffice for the purpose. It would be necessary 
to create successive models to determine their power as instruments of 
research and explication, selecting certain elements from some as a basis 
for the long-term monitoring function of the proposed admini?5trative unit. 
The present paper fits within tliis context. It is a tentative start at 
providing a framework of discourse within which numerous models might be 
proposed. It should go without saying (but doesn't) that thi$ is not the 
only framework of discourse which may be employed; others are invited to 
add their own frameworks: ^ national system of research and development is 
a concept which, in our society, has such breadth and complexity that its 
ramifications defy the imagination, much less the ability of systems 
theoreticians to codify it. 

A further caveat is necessary: this framework is the slave of its 
purpose, just as the systems proposed by others serve their designs. 
The purpose here is speculative, to expand the horizon of most existing 
models proposed for the educational R 8D system. It is not intended as a 
guide to short -tern action. More specifically, if the discussion raises 
areas of a potential "E l) syi>t6m" which are a bit far-fetched and unrelated 
to present public poli-:: / concer^is , this is not intended to suggest that 
they should be policy conoems. There is no implication that such "new'* 
areas are, should be, or ever will be, the object of any federal pro-am. 
Nor is it proposed that they be included in an NIE monitoring system. 
Though there are potentially many policy applications of the framework, we 
are now dealing with speculation, not programs for action. 
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B. ^DNITORING AS, A FUNCTION OF NIE 

Since 1953 the National Science Foundation has carried out regular 
annual surveys of research and development activities in the United States 
(cf, NSF 1971, 1972). Its numerous reports and publications are at the basis 
of almDst all the work which has been done on an international level to' 
develop a system of international comparisons (Lefer 1971) . Given this 
situation, the question iinnediate]y arises: what is the role of NIE in 
monitoring the component of the R&D system that deals with education? 
The straightforward answer is that the NIE should do monitoring which is 
closely related to its mandate but, wherever possible, by taking advantage 
of NSF work and avoiding duplication of it. Let us defer c^iscussion of the 
NSF data collection framework until later and concentrate on the needs of 
the NIE. 

The creation of a monitoring system would be of great assistance in 
assessing the success of the NIE in carrying out tha portion of its mandate, 
mentioned earlier, concerned with building "an effective educational research 
and development system." But the information provided by the monitoring 
system would be of potential utility for all aspects of NIE operations . 
Generally speaking, the following functions can be assisted by a monitoring 
system: 

1) External communication and. public accountability: 

Regular reports on the status of the R&D system can be a vehicle 
to communicate about the whole range of NIE policy interventions 
and their impact. The cumulative effect of such reports over a 
period of months and years will be to provide baseline data and 
a yardstick to measure the effectiveness of the NIE. Reporting 
about, and research on, the R&D system will have a tendency in 
the long term to shape national conceptions of what R&D is and 
what education is. 

2) Internal policy mking : A monitoring system, should assist in 
policy making by providing advance indication of problems that 
require policy initiatives for their solution. In general, the 
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problen^ will either result from an imbalance or iraladjustment 
withjji ar^as currently covered by policy initiatives or from 
the appearance of new factors outside the focus of current 
policy concerns; this suggests that mDnitoring will be most 
intense as regards current areas of policy intervention but . 
that the system would also , keep track of events in a broader 
context on a more. distant basis. In summary, the first 
function is problem identification. 

The second function is to assist in weighing policy alternatives, 
,. supplying, data on (a) the context of decision-making apd (b) 
the predictable impact of policy alternatives • The third 
• ^ function, closely related to the first, is to provide feedback • 
\>) on the consequences of policy initiatives . 
3)j Research on the system : The advancement of knowledge on the 

-' operation of the educational R&D system is a valid subject for 

scientific enquiry. The advancement of such research being 
within the purview of the NIE*s mission, it follows that it is 
worthy of attention in its own right, independently of the fact 
that explication of causal relationships within the system can 
be of crucial importance for effective policy making. 
C, APPROACH 

The discussion that follows is divided into three major sections . 
The first section is intended to acquaint the general reader with a framework 
of discourse on modelling. A specialized vocabulary is presented and basic 
concepts of monitoring are presented in terms which, it is hoped, will be 
generally accessible to most readers but sufficiently precise that the 
professional systems analyst will have no difficulty in "translating" them 
into his usual terminology. (Ihe reader with previous experience with the 
jargon of systems analysis will probably wish to skim through most of this 
material to determine the degree of simplification used and the exact context 
of familiar terms). Since a complete discussion of the literature relevant 
to the nDdelling of educational systems is beyond the scope of this paper, 
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a "bridge" has been provided in the last part of the first section, in which 
a number of familiar ncdels are discussed using the terminology and concepts 
just defined. Ihe second section is a discussion of modes of tracing 
boundaries for the educational R&D system. Numerous definitions of R&D and 
of R&D systems have been given in the literature. This section does not 
attempt to pick one of them or propose a new one; rather, a set of ge- ' al 
criteria for tracing systems boundaries are explicated and the concept of an 
educational R&D systeir. is expanded well beyond the usual acceptation . For 
specific mDnitoring tasks, the criteria can eventually be applied and used 
to include or exclude parts of what is called in this section an "extended" 
concept of the educational R&D system. The third section deals with a 
specific franework for ntxielling the educational R&D system and reporting 
on it. The purpose is to present a broad framework sufficiently conp?ehensive 
to accomncdate mast current models of R&D and the great majority of data 
available from either large-scale sampling at the national level or research 
on portions of the system. The author apologizes in advance for the 
shortcomings of this hazardous attempt to provide a framework capable of 
integrating and interrelating msaningfully data that is derived from numerous 
sources using different methodologies of research. A concluding section 
relates the framswork to immediate NIE ccaicems. 

One final caution is necessary. Given the general aims of this paper, 
it would not be appropriate to use the terms R&D or research and development 
in a "correct" and therefore restrictive sense. Unless otherwise specified, 
these terns are used in a colloquial sense to refer to the whole spectrum 
extending from basic research through applied research to development and 
implerentation of innovations. This ir.-precision is a necessary correlate 
of an attempt to discuss diverging views of the R&D process , some of which are 
extremely broad. 
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A, PURPOSE 

The purpose of this section is to acquaint the reader with a franework 
of discourse which will be used in the remainder of the paper. An atterrpt has 
been nade to provide a framework capable of being readily understood at the 
intuitive level, yet sufficiently clear that, in specific applications of the 
framework, precise definitions can be given. The framework is presented in 
two parts: a short "vocabulary" and a definition of the concept of mDnitoring 
in so-called "systems" terms. This is based upon an adaptation of usual 
terminology enployed in descriptive analysis of systems. In other words, 
nothing really startling or "new" is being proposed. 

The utility of the framework of discourse should be tested against 
the following criteria: 

1. Intuitive understand ability for the non-trained user. 

2. Generality sufficient to accomodate differing viewpoints on the 
system being analyzed (including different viewpoints about what 
should be the system boundary , of which more later) • 

3. As a specific criterion derived from criterion (2) , ability to 
accormiDdate a major portion of current "models" of R&D, either 

as regards model content or the context of model definition. In 
other words , one should be able to map many existing models into 
the framework without distorting them; similarly the framework 
should permit the description of the processes by vfliich the models 
themselves were formulated. 

4. Utility for persons engaged in a variety of tasks: 

- generating research ideas 

' - re^- "ting research findings 

- reporting long-term changes in the systems under study, i.e. 
social bookkeeping activities. 

- discussing and formulating policy alternatives. 

A suiTiinary of these criteria is to state that the framework is a tool 
whose worth should be judged by its applications. 
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B. LANGUAGE CONVENTIONS 

1. Models 

In orxiinary discourse arang systeins analysts (whether or not this is 
their job title) , a "nodel" is a fornalized description. Th . object of the 
nodel nay be some part of perceived reality (a chair, how checks are processed 
at a bank, how change occurs in a school) or a state of the describer's 
imagination (a proposal for a new policy, a Utopia of a deschooled society, a 
poem). Our discussion will center around models descriptive of something (still 
undefined) called a "national R&D system", including the proc-ss by which its 
goals are formulated and by vSiich alternative definitions of the system are 
proposed and developed. For the purposes of our discussion, models will 
ordinarily consist of: 

a. A definition of system "elements" 

b. A statement of relationships between elements. 

2. Element types 

Most of the purposes of this paper will be served by proceeding aS 
infomally as possible , leaving the reader to formulate intuitive iirp?essions 
of some itens rather than forcing him to digest corrplex abstractions . The 
series of teme defined below are the classes of items which can become system 
"elenents". In applying them to a definite model, one will give them further, 
fornal definitions and specify relationships according to the aims of the nodel 
builder. The definitions given here can be "mapped" into the formal definitions 
and the usual terminology of systems analysis with little effort. In many 
applications of irodels, the degree of formality in describing and categprizing 
elenents can be left rather low, as the actual observation of the elements will 
involve sonK rough approximation vdiere fineness of definition is lost. 

The proposed list of tErms is as follows: 

1. agent: One or more persons concerned with any phase of 

the R&D enterprise: 

One determines the level of "aggregation" according 
to utility for the phenomenon studied, e.g. the 
university department might be a useful level for 
studying some aspects of financial support for R&D, 
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2 . regulators : 



3 . flows : 



4. events: 



5. pools: 



6 . medium ) 
?• message ) 



the researcher (or perhaps the research team) 
might be an appropriate unit for studying 
creativity in basic research, the local cojiinunity 
for studying changes in expectations re^rding in- 
school discipline. 

Procedural conventions , determining the activity of 
agents: lue. most easily defined regulators are those 
derived from statutory law (e.g., legislative mandates 
for funding R&D, laws or regulations goveming the 
adoption of textbooks) ; formal policy codes of public 
institutions are also accessible ; de facto behavior 
patterns of, say, education administrators faced witti 
decisions on adoption of innovations , may be as 
crucial as the foregoing but are far harder to 
document and describe. Personally perceived, or 
administratively prescribed, role definitions as well 
as v.' : ; systems of individual agents or classes of 
agents, are "regulators," 

Any (input /out put) vai dable affected successively by 
two or irore agents of the system. The variables are 
chosen according to their utility for analysis. 
Interactions between any system elements (agent-agent, 
agent-flow, etc.). 

A handy catch-all for system elements whose behavior 
is difficult to predict because they break out of the 
system "boundary" (i.e. what the analyst chooses to 
see or study) and return at undetermined intervals: 
"iianpower pool", "knowledge pool," etc. 

These two elements refer to the classic distinction 
between message content and its physical encoding. 
The definition of each is left at the intuitive stage 
in this i^per. The reader is reminded that the term 
"medium" does not refer to the equipment or physical 
installations associated with delivering messages, e.g. 

broadcast studios for television, v^ich would be called 
... ..4 
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8. equipnBnt: Physical devices or installations (laboratory 

apparatus, physical plant, etc.) 

9. indicator: Any system eleinent from the above set of e lenient s 

which is observed in the real world as an indicator 
of how the system, or a part of it, is operating. 
It should now be clear that soitb of the system elenents overlap: '^ssages" 
might be one type of "flow" studied at a given tine . The point about these cases 
of overlap is that they are easy to recognize and deal with when applying the 
terms to specific examples. 

3. Remarks on application criteria 

There is no general rule for selecting elements for inclusion in a 
study, other than the general criterion of usefulness for the job at hand, whatever 
that nay be. Anything in the universe is potentially related to anything else. 
"System boundary" is the technician's term for indicating the point at- v*iich the 
analyst feels it is expedient to stop analyzing and describing relationships . 
With regard to the study of the national educational research and development 
system at NIE, it is necessary to point out that there are clearly two different 
(though closely related) types of work to be done: 

a) Social bookkeeping or long-term monitoring • 

There is a need to know how the R&D system evolves over a 
a long period of time. This provides a sort of over-all 
benchmark for R&D on a nationwide basis. 

b) Explicating: One should like to advance the state of knowledge 

about how an R&D system works , explicating causal relationships . 

Soitb results may be of general interest only, others may help 

to shape policy-making or to re- shape the long-term task of 

monitoring the national system. 
The criteria for selecting the elements and relationships to include in a system 
iTDdel for study are very different , depending on the task to be fulfilled . The 
social bookkeeping task is of value only when carried on over a period of time, 
using similar (or the saire) categories of flows and agents for study repeatedly. 
In short, a priiiB criterion for selection is durability over time: Ph.D. training 
prograiie in educational psychology have existed for many years and are likely 
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^ ^ existence for years to come; they might well be sairpled regularly 

^ 0p ^ of a given type of opportunity for research training. Unfortunately, 

^ur3^^^ ^ hard to predict, and durable variab.es do not always ha^/e much 

^xpl^ "■'^ue for getting at causal relat:* : nships . Simply knowing the 
of 

^ujrt^ ^ S^aduates from doctoral programs in educational psychology would not 

§o explain, for example, why the proportion of graduates entering 

^s6^^^ ^^^^rs mig^t rise or fall over a decade. 

^ Search for causal ^relationships leads to selection of agents or 

^ow^ according to their perceived impact on tJie process under study. 

^Ucl^ . ^ generally (though not always) concerned with flows related to 

te^ ^ ^et of "agents", e.g. the development -dissemination-adoption 
0 of ^ 

^^roc^ Regional laboratory during a five-year period could be studied in 

^^rrJ^ • ^ Elaboration and diffusion of a given set of innovation prototypes 
^^ig^^^^^ the laborato^^/. Questions regarding national policy or the 
^^r\^f^^^^ ^^tiveness of the R&D system would require different approaches: 
^ith^^ ^^Oss-sectional aggregation (almost always by straight summing) of 
^ata^ ^ numbers ot agents (researchers, research institutions, etc.), at one or 

^re ^^iods or (2) longitudinal analyses of flows through nuiiErous agents 

ti^^ relating a given output to a given input (e.g. an econometric 

^^el ^'I'^^'^g funding variations to oystem outputs such as number of Fh.D's 
^an-t^^ ^^^ial sciences). 

C^^^^^'^^- ^TU'S^ , MONITORING SYSTEMS AND INDICATORS: AN INTRODUCTION 

. ^nitoring as part of a control system 

possible to conceive of monitoring as a passive, experiential 
h>oc^^^' '^^^ ^ct of observation does not imply participation. We all can look 

a ^ ^Qne from a distance as dispassionate observers. Put for the 

^\xrrfi^^^ ^ ^is paper, monitoring should be placed in a differ er.r context, that 
pc?^*^^^. ^^g- I^nitoring can be seen to have a different, ncre active sense; 
^hse'C^^^ ^ the prelude to action. To understand this other sense, it is 
^^ceS^^^ ^gin with a simplified concept of what is irrplied by policy-making; 
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11. 

this simplified ntxlel ccin tlian be generalized to cover the whole range of 
^situations involved in a monitoring system of national scope . 

Goveminental policy-rraking is essentially aimed at creating some 
outward effect, at modifying a portion of the legal, political, social or 
economic environirent . For the analyst, this means that it can be viewed as 
a mechanism for exercising "control" over the environiTient , a perspective 
which offers the possibility of fitting it against a relatively uncomplicated 
mDdel of a control system. Using block diagrams, we can visualize a simple 
control system as follows : 



Insert Figure 1 about here 



If this hypothetical system is further analysed, it can be converted to the 
classic format of a "feedback" loop: 



Insert Figure 2 about here 



From this diagram it is possible to abstract the essential elements 
of a control system: 

(1) The object system, a defined system whose activities are the 
object of the control process. 

(2) A procedure for gathering data on the status of the system. 

(3) A procedure fo.-' analysis of data gathered, primarily by 
coirparison with some set of norms or criteria (this may be 
a conparison with the immediately previous state of the 
system, a means of determining "trend"). 

(4) A decision-naking process by which alternative possibilities 
for initiating controlling actions are weighed and a selection 
is made. 

(5) An inplementation i?rocess by which the course of actxon chosen 
is carried out, that is, a control mechanism per se. 
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From the point of view of this paper, monitoring can be defined as elements 
(2) and (3). In practice, however, an administrative unit responsible for 
monitoring would ordinarily participate in the process by vtfiich alternative 
possibilities for action are weighed, though properly speaking this is 
decision-noking, not monitoring. 

Before proceeding any farther, a methodological aside is necessary 
to clarify the applicability of this model of a control system. The term 
control is used in everyday speech to imply total control: "Jones controls 
the city hall machine" is a sentence implying that what Jones says , is what 
the nachine does. In the study of large systems it. is quite clear that 
total control, in the sense of colloquial usage, is not possible; with 
regard to social systems, total control implies totalitarianism (a form of 
government which, by the way, has never succeeded in achieving complete 
control in any situation). The term control is used here in a limited sense 
to mean the ability to affect to some extent the behavior of the object 
system. This is obviously the meaning which must be given to the term 
when dealing with policy-making affecting the conduct of educational R&D. 

2. Components of a monitoring system 

The major problems associated with creating a monitoring framework 
for the needs of the NIE arise from the diversity of the system elements 
to be studied and the corresponding diversity of methodologies which will 
have to be used. Different kinds of data will be available in an unrelated 
fashion, ranging from research on communication patterns within innovative 
schools to the breakdown of expenditures on individual R&D projects in 
university research centers . More than a problem of compilation , there 
is a problem of conceptualization. Much of the data will be available from 
"research", that is, it will be gathered in the light of scientific interests 
quite apart from immediate NIE policy needs; the researchers involved will 
not, in most cases, consider that their work fits within -:he "control system" 
framework sketched here. Their contributions to the growth of scientific 
knowledge may usually be justified in abstract terms independently of their 
eventual utility for policy -naking. Conceptually someone will have to fit 
the pieces togethf^r. The first stag^ in this process will be understanding 
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how data sources relate to an overall concept of a control system, how 
research findings are indicators of object system performance. 

The underlying concept is deceptively simple. If we return to the 
earlier schema of a control system, we will note that the object system is 
viewed as having "inputs" and "outputs". This is roughly equivalent to the 
stateiTBnt that, if we look at the national R&D system as a whole, it will 
be possible for analytical purposes to divide it into sub-components which 
perform some process in response to some stimuli ("inputs") and produce 
soms results ( "outputs" . An illustration might be that one vould be 
interested in discovering the level of financial support (inputs) received 
by a research laboratory and the nature of the research outputs produced. 
Vfe would wish to sample the inputs and the outputs perhaps as a means of 
iraking policy on future financial support. The process might be diagrammed 
as follows: 



Insert Figure U about here 



-V This "input /output" model is not limited to describing situations in 
which the object system is visualized as operating changes in something 
that flows "through'* it, for exanple, a factory process in which machines 
transform raw materials into finished goods on an asserrt^ly line. The 
ioDdel is much more general. Logically it can be transposed into what 
one might call a "time series" format. The object system, which is 
initially in state A, undergoes a change during a period of time, at the 
end of which it is in state B (cf . Figure 3)* This means that the 
TTOdel is applicable to all types of status or behavioral changes occurring 
over a period of tine, independently of v*iether the factors occasioning 
those changes can be identified. 



Insert Figure 3 about here 
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in which the object system is viewed as undergoing 
a change of state, from state A to state B 
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In the diagram, the laboratory would be the object system, points A and B would 
be sampling points, i.e. the place in the system where data is gathered. In 
practice, certain difficulties might arise owing to the delay which separates 
the beginning of a research activity from the accomplishment of its purpose; 
if data on financial inputs were available for only one given year, it would 
be inappropriate to relate those inputs directly to the research results of 
the year, whicn probably would depend in a large measure upon investments 
during previous financial periods. Ideally, one would wish to have, there- 
fore, a record of inputs and outputs over a period of time and, in addition, 
sone indication of research work in progress , as illustrated by point C in 
Figure 5. 

Insert Figure 5 about here 

For various purposes, it may be useful to observe the distinction between 
three types of indicators for any part of the system under study: input, 
output, activity level (activity in process). With reference to the example, 
a sirrple count of projects underway might bo considered an indicator of 
activity level, though admittedly a very poor indicator. 

3. Applying the monitoring; schena 

When dealing with large or complex systems, it is usually necessary 
to proceed to a sub- analysis in order to define activity level, as illustrated 
in Figure 5. Tne introduction of sampling point D 



Insert Figure 5 about here 



between the two components of the object system corresponds to the identification 
of an intermediate indicator of system perfornance. Ref^jming to the example 
of a research laboratory, it might correspond to the acceptance by a specialized 
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review body of the detailed project design for a given project; completion of 
this stage might be associated with a high probability of successful completion 
(during passage through component 2 in the diagram) . The use of intermediate 
indicators of system performance is frequently necessary for one of several 
reasons : 

(3) Process delay is so great between input and output that pertur- 
bation's in the system will go undetected until so late that no 
corrective action can be undertaken, 

(b) There is such an indirect relationship between inputs and outputs 
that prediction of outputs is virtually impossible from input 
data alone. 

(c) There may be no adequate means of determining total system 
output, so that one must be content with summing intermediate 
outputs . 

(An example of how a complex system can be divided into components, is given 
in Section 2, where a "skilled iranpower system" is sketched: The division 
between a "prirary specialized training systen" and a "job activities system" 
is usually necessary due to the tenuous relationship between training and 
work; in nost cases, one would have to be content with intermediate indicators, 
such as number of certificates awarded in training, to juQge effectiveness 
of the primary specialized training system, rather than seek to assess the 
ultimate goal of productive work outputs over a long period of tijve. At 
present, the evaluation of most job-oriented training systems is seldom 
carried beyond the stac^,e of determining the number of appropriate initial 
job placements). 

The schema given of the elements of a control system permits us to 
identify the steps in defining a monitoring system. To begin with, there must 
be one given, namely a general set of goals for monitoring, based on an 
understanding of the purposes which the data furnished is to serve. The 
functions proposed for an NIE monitoring system in the introduction may serve 
as an example. Once such goals have been set, the definition of a monitoring 
framework is possible. The steps are: 
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1. Definition of the boundaries of the system to be ironitored, 
specifically by stating the grounds for incluiing or e^luding 
elements that might potentially be part of the system. 

For example, if one is going to study basic research in the 
field of psychology, one should state the definition to be 
used in deciding whether an activity constitutes research, 
whether research is basic or applied, v*iether it is 
psychology (as opposed to the biochemistry of neural 
processes)^ etc. 

2. Definition of a framework of analysis which will permit data 
derived from monitoring to be related to the information 
requirements of users. 

3. Specification of indicators to be used for observation and 
procedures for data collection, analysis and reporting. 

It should be noted in passing that these steps correspond roughly to the 
organization of the subsequent sections of this paper. 

But, if the underlying concept of monitoring is simple, its 
application to large, conplex systems frequently appears hard and confusing. 
The major difficulties are usually resolved by the procedures outlined above 
the subdivision of large systems into smaller components that are easier to 
study and the substitution of intermediate indicators of performance for 
the indicators of *'final" performance v^ich one would prefer to obtain. 
Given a policy-naking framework conceived as involving the two functions of 
monitoring and making choices between alternative actions, it is obvious 
that the monitoring function is synonymous with the processes of observation 
used in empirical sciences. In setting up a monitoring system for the 
national educational R&D system, it will be necessary to choose judiciously 
what are the points in the system from which relevant data should be sampled 
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and what are the test ireans for obtaininj^ the data. But, in the end, there 
ar^^ no fundaiiiental nethodological obstacles to intepgratijig data from widely 
disparate disciplines into a corruiDn framework. The obstacles are all 
practical: how to relate one data base to another and how to report 
intelligibly about such a vast , rtiultifaceted system to a variety of publics 

D. USING im FRAMEWORK TO DISCUSS COMMON , MODELS OF R&D 



1 . Trends in the literature 



A summary of the literature on educational research and development 
is beyond the scope of this paper. At most one can sketch a few trends of 
the literature and then examine how certain familiar nodels of educational 
R&D appear when cast in The light of the need for developing a monitoring 
franework for the NIE. Any discussion of this sort should be preceded by a 
clear disclainfir. Pointing out a "weaJcness" in a model does not imply a 
lack of conpetence, knowledgeability or performance on the part of the 
persons v*io created it. In most cases the irodels discussed here were 
developed with a clearly defined set of purposes and were adequate for 
those purposes. In fact, almost all of the discussion that follows will be 
addressed not to particular models but to a whole literatiire on models , from 
which examples are selected. 

To schenHtize very broadly, the literature relevant to models of 
educational R&D approaches the problem from two major perspectives. One 
perspective is a sort of "inside" view, originating with persons involved 
either in managing, carrying out or using the results of educational R&D. 
The other perspective is an "outside" view of persons who have studied the 
progress of science or R&D as a whole and whose work therefore has some 
application to educational R&D; for the purposes of this paper, the most 
inportant of these outside perspectives is provided by work that treats 
R&D from the point of view of developing national accounts or national 
indicators . 
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A succint suirmary of the "inside" literature on educational R&D is 
given in Educational Research and Development in the United States (NCERD 1969, 
pp. 1-7) . The summary is useful in that it points out that most literature in 
this area centers on one of either research, development or dissemination: 

. .there is not a great deal of literature on the relationship of research to 
development, or development to research, or the relationship of both to the 
inprovement of education." (Ibid, p. 5). This situation has changed rather 
rapidly since the publication appeared- Perhaps spurred cn by the nounting 
evidence that the results of educational R&D were not having a broadly 
significant inpact on educational practice and partially in response to the 
interest surrounding the proposal to create the National Institute of Education, 
an increasing number of authors have dedicated their efforts to explicating 
the lin]cage between R&D and educational practice, or more correctly, to the 
failure to develop effective linkages. This change was already evident from 
the nassive report of Del Schalock and Sell, known generally as the "Oregon 
Studies", published in 1972 (Del Schalock and Sell 1972). Other recent 
reconceptualizations and summaries of the literature hav^ been produced by 
scholars both in the United States (cf . Havelock 1969, 1970; 
Pincus 1973) and abroad (Fullan 1973, Huberman 1973, Dalin, in press). Each 
of the authors cited as a more recent reviewer has also contributed 
significantly to clarifying the concept of an educational R&D system, marking 
an advance away from the failure to explicate relationships , referred to in 
the NCERD study. 

As mentioned earlier, the national accounts approach to monitoring 
R&D began in the early 1950 's with the survey work of the NSF. Since then 
the problem of monitoring R&D at the national level has been taken up elsewhere 
in the world, particularly under the aegis of international organizations 
such as the Organisation for Economic Co-operation and Development, UNESCO 
and the Council of Europe. Although attention was initially directed to 
the natural sciences, in recent years a significant literature has appeared 
dealing with monitoring activities in the social sciences (cf . Fteeman 1969a 
& 1969b; Lefer 1971; OECD 1972; Trist 1970). This literature on the social 
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sciences has begun, by implication, to include educational RAD. I'he NSF 
surveys do include research in the social sciexices (and, therefore, in 
education), though they exclude developjient , truncating the R8fD continuum 
at one end. 

2. The "external*' perspective ; R&D in national accounts 

The utility of the data furnished by the NSF for the concerns of 
the NIE will be dealt with in the last section of this paper. At this point, 
our objective is mainly to see how the monitoring model used by the NSF 
matches up with the conceptual framework outlined earlier in this section. 
At the present time the "state of the art" for national accounts of R&D 
systems is represented by the NSF surveys and, in particular, the recent 
publication Science Indicators 1972 (National Science Board 1973) . The basis 
of alnost all such studies is to* 'provide measures of inputs to the R&D 
process as if they were surrogates of outputs : that is, one measures the 
resources used for R&D, such as money spent, equipment purchased, skilled 
nanpower employed, number of research institutions or organizations in 
existence and number of potential R&D workers trained. Science Indicators 
1972 goes beyond this by introducing the first large-scale attempt to measure 
R&D outputs on the basis of three types of indicators: number of scientific 
publications published by country, number of citations of literature by 
country and a so-called "patent balance" based on the ratio of the number of 
patents granted in each country to its nationals and to foreigners. In 
addition, there is an attempt to get at the indirect benefits of R&D by 
measures of productivity, technology transfer and balance of trade in technology- 
intensive products. An experimental section on attitudes of scientists and 
the public about science problems is also introduced, as a sort of indicator 
of the "environment" of the scientific system. •:fhe set of indicators is 
indicated in Figure 7 , a small adaptation of the monitoring model shown 
earlier. The main indicator sampling points are as follows: /w resource inputs 
(noney, equipnent, trained personnel), research results (publications, citations, 
patent balance); C. activity level (number of research organizations, persons 
employed); D. environment (opinions of scientists and public); E, indirect benefits 
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(productivity, technology transfer and balance of trade). 



Insert Figure 7 about here 



The 1969 NCERD report Educational Resea3?ch and Developnient in the 
United States should also be mentioned as the sole major existing effort at 
manitoring educational R& E from the perspective of national accounts • The 
"indicators" presented in the report involve, by comparison with the NSF 
studies, Ttore reliance on narrative description based on secondary sources, 
than on direct neasurement. The same indicators (dollars and numbers of 
persons) are used for resource inputs; with regarxl to indicators of proce-vS 
or activity level, the report includes narrative deSvi?iption of institutions 
engaged in R&D and the techniques of research management; the research 
eniironment is described in chapters on the history and on the organization 
and current problems of education in the United States; outputs are assessed 
in chapters describing major recent programs and studies . In other words ^ 
the framework transposes exactly to the schema given in Figure 7 for the 
NSF monitoring system, with the exception that the indicators are generally 
subjective. On the other hand, from the point of view of a person interested 
in formulating policy on educational R&D or understanding how it operates', 
the NCERD study is far more interesting and informative than would be ari 
adaptation of the NSF methodology to the field of educational R&D. Ttie 
tradeoff between objecti^city and relevance of indicators is as muich a probl.fim 
for science policy as for any other field. 

3. The "internal" perspective 

If we examine the literature written from the "internal" perspective, 
it is clear that most are partial models of one portion or another of the 
monitoring schema, usually the process at the center of it. For this 
reason, transposing them against the monitoring schema reveals little of 
interest. It is probably more appropriate to select a few familiar exanples 
of model types and rephrase them in terms of the language conventions 
mentioned above, pointing out their relationship to the monitoring schema 
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only where it is not self-evident. Before we begin, it should be pointed out 
to readers who lack familiarity with flow charts and diagrams, that the 
graphing conventions typically used to illustrate irodels have the property 
of "napping" into each other on a basis of exact equivalence, e.g. a flow 
model using boxes and arrows to illustrate relationships between elements 
can easily he transposed into a data matrix format familiar to the veteran 
reader of statistical tables or analyses of experimental data. Difference 
in presentation fonrat should not hide the underlying unity of the conceptual 
f rameworic . 

A gpod part of the model literature can be seen as describing the 
roles of agents. This could be graph'^.d as the correspondence between two 
lists : 



Insert Figure 8 about here 



Ihe list headed "Roles" in the figure is usually comprised of a list of 
activities that can be carried out by the agents, in the sense of an explicit 
or implied division of labor. These taxonomies are based upon a sequence of 
activities deemed to be "necessary" or "natural" for research and development, 
e.g. 



Insert Figure 9 about here 



or in the usual taxonomy : 



Insert Figure 10 about here 



Although some authors' analyses introduce finer detail, those refine- 
ments consist primarily of subdividing and describing in greater detail t'^e 
possible roles that may be assigned to different agents, e.g. in the r*->ifi'i. 
of Guba and Clark (1968): 
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Without essentially changing the framework Del Schalock and Sell (1972) 
carry the process one step further, basing their primary definitions upon 
the construct that research, development, evaluation and diffusion are 
problem-solving strategies, i.e. a means to achieve a desired goal. 
Remarkably little attention is given to the problem of goal definition. 
As such, the framswork they propose is most useful in analyzing the instru- 
mentalities of research and development rather than its end; it provides 
a series of categories for classifying descriptive data on organized, 
institutionalized research and developnent activities. The essential 
limitations of the framework for the purpose of describing a national 
system of research and development in education can best be seen by 
situating the Del Schalock and Sell article in a larger framework. The two 
authors can be viewed as contributors to a process of policy-making on 
educational research and development, in which they appear as proponents of 
a particular school of thou^t. The t3?iumph of their definitions (or a 
related set) as the de facto norm, for ^Xi^iple, in granting public financial 
support to R&D and nanaging R&D projects would have certain unsatisfactory 
implications. The limitations of their approach — limitations consciously 
adopted, it should be recalled — are clearly evident in a footnote to the 
paper, in which the authors acknowledge that they have given "a relatively 
narrow definition of research if the inquiry related activities of the 
mathenatician, historian, and p^iilosopher are also to be considered" 
(Del Schalock and Sell^ 1972, p. 215). When describing a national system 
of educational R&D it would require considerable lack of political horse- 
sense to exclude such researchers from consideration, even if they are 
usually given short shrift v^en it comes to awarding research funds. 
Conversely, v*ien searching for ways to categorize institutionalized R&D 
of the type Del Schalock and Sell set out to describe, it would be equally 
shortsighted to exclude their taxonomy from consideration as a potential 
basis of data collection and/or analysis. 
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Most of the literature dealing with research and development as a 
mechanism of planned change has been spent on prescriptive definitions of 
the process as viewed by those vAio propose to plan, manage and induce the 
changes. The examples cited briefly above are illustrative of a whole 
school of thou^t, concerned with ijnproving the effectiveness of R&D as a 
change mechanism. An almost opposite approach is to be found in a part of 
the literature describing the process from the point of view of the "object" 
of the planned change — the "user" of R&D, the "client", etc. Although 
nuch of the literature, reviewed in the articles cited earlier, is concerned 
with similar prescriptive definitions of roles (change agents, leaders, 
linkage agents, etc.), the descriptive approach is strongly represented. 
The conceptualization -of change as a "diffusion" or flow process has resulted 
in many important insights , though not so many as to prevent even major 
blunders by researchers. As the recent article by Fullan (1973) points out, 
many of the studies of diffusion have been based upon very poor data sources , 
exaggerating the role of authority figures in the diffusion process . A 
principal's announcement of the adoption of an innovation is not proof that 
the innovation is being used by the teachers in his school. 

The problem appears to be with poor application of flow descriptive 
models, not with the underlying concept of the models. Upon analysis, these 
models of change can be seen to fall into two general categories. The first 
is a variant of the sociogram, a charting of influence patterns, e.g. how 
influential is a given superintendent, indexed by the number of other 
superintendents who report following his lead in adopting an innovation: 



Insert Figure 11 about here 



The model reduces to a group of agents, superintendents, linked by a sinple 
relationship, reported influence, and charted against a dimension of tijne 
periods . The second type of model is some variant of a message transmitter- 
receiver model; Havelock's definition of the linkage irodel (Havelock 1973, pp. 
can serve as the prototype: 
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Insert Figure 12 about here 



where L is the possessor of expert knowledge (the "linker "J and U is the 
person who has an existing or potential need for that knowledge (the "user") 
this reduces further to a nessage transfer either from user to linker or 
linker to user: 



Insert Figure 13 about here 



In terms of our vocabulflry conventions, this event can be seen as the 
interaction of two "agents" consisting of the "flow" of a "message". Such 
events are usually traced against two frameworks, i,e, the flow of a given 
inessage or class of inessages along a chain of agents 



Insert Figure 14 about here 



or the time sequence of events affecting the agent in a given period: 



Insert Figure 15 about here 



or some variant of the above. 

A final class of "models" is constituted by the implicit mcdels 
built into studies which have been done on the operation or constitution 
of some conponents of the R&D system. In the process of defining a 
research problem, deciding on a data collection framework and analyzing 
results, researchers have explicitly operationalized definitions of one 
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Figure 12. 



45 



ERIC 



24b. 




Figure 13, 



46 




Figure 14. Example of a message transmission network 
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or more portions of the R&D system. Typical exaniples of this type of 
research include the work by Sieber and Lazarsfeld (1966) on organizational 
patterns of research ana by Clark and Hopkins (1969) on the supply of 
trained manpower for educational research, development and diffusion. In 
most cases , such research on the system is based on definitions or schema 
already known in the literature, of which the major prototypes have already 
been dealt with here. 

Two points should be made about this brief review of models of 
educational R&D: The first is that the vocabulary conventions and ironitoring 
Schema is adequate to deal with these cases. The second is that, despite 
the large amount of literature written on the subject of educational R&D 
in the past few years, there are surprisingly few attempts in the literature 
to describe how the whole system interacts. The IS 59 report by NCERD 
remains the sole integrated attenpt to describe a full range of institutional 
sponsors and performers of educational R&D and the associated financial 
Support. Even that steady hardly scratched the surface, dealing pri:iv.'..: 
with R&D serving the K-12 educational system and funded by the federal 
government or private foundations , from v/hich very gross estimates of tunds 
granted were obtained on a one-shot basis. Other sectors were dealt with 
only summarily, if at all. Rather than call these omissions "limitations 
one should probably point to them as gpod indicators of the realism that 
went into writing the report : major interest attached primarily to the 
K-12 system; the only available data for writing covered the public sector. 
Because these constraints continue to prevail, the justification of the 
present paper is that it is interded to assist in discussing longer term 
issues . 
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Sect:lon 2. Defining System Contours; The Major Problem Areas 

In the previous section we hav,^. defined a proposed framework of 
discourse and shown how it relataa to other frameworks for discussing models 
of research and development. The discussion of previous models is only 
sketchy and does not do justice to their content; its purpose has been to 
show how the structures of models map into the framework, not to discuss the 
contents of the structures. It is hoped that this initial application will 
be helpful as an introduction to the next set of issues: How can one expand 
the concept of the national R&D system? The 'expansion' of the concept poses, 
turn, of course, the problem of relating the expanded system to a reporting and 
monitoring framework, which is the last section of the paper. For the moment 
we shall concentrate on: (l) identifying aspects of the R&D system likely to 
be of interest for policy or research (2) exploring their general content as 
broadly as possible. In other words, we are casting our net wide in this sec- 
tion, not being hampered by problems of actually getting data on the phenomena 
discussed. 

If asked directly the question "What is the national educational R&D 
system and what is its current status?" most knowledgeable persons would be 
inclined to think immediately of the network of existing institutions which 
carry out H&D functions. Their personal definition of what constitutes an 
"H&D function" would be the criterion defining what the system is, and a 
description of the institutions carrying out that function would constitute, 
therefore, a description of the national educational R&D system. In all 
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likelihood, that description would include "institutions" that are broadly- 
defined, much along the lines of the term "agents" introduced earlier. Our 
purpose in expanding the concept of the R&D system is not to reject the con- 
cept that the institutional framework is probably the principal element 
involved in such a description; it is rather aimed at two goals; 

(1) Increasing the number of agents included in the description to 
match a broad concept of what constitutes an educational R&D 
function. 

(2) Refining the types of analysis which are used in arriving at a 
description of the system, emphasizing the interactions between the 
elements in the system. 

The procedure used will be to begin with a definition of educational R&D 
so broad as to include most alternative definitions. Using this definition 
as a central vantage point, we shall examine a series of "subsystems" that 
seem to lead outwards from it. (The process is roughly analogous to that of 
the astronomer who looks from the world outwards to chart the contours of the 
observable universe). Generally speaking it will be clear that the subsystem 
can involve a changing variety of "agents." In cases where the agents 
involved are not clear from the discussion or where there are so many 
possibilities that the "expanded system" concept becomes unmanageably large, 
an attempt will be made to describe the agents explicitly. Otherwise, 
no description of agents will be undertaken in this section. 

As far as possible, an attempt will be made to deal with the subject 
matter in terms which are familiar to the general reader and to explain those 
which are not. The sequence of presentation will be: 
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(a) Knowledge organization and utilization, or the B&D "flow" 

(B) Media and message systems 

(C) Resource inputs to H&D 

(D) Regulatory systems 

A. RSD IN THE PROCESS OF KNOWLEDGE ORGANIZATION AND UTILIZATION 
!• R&D; A model and a definition 

In an appendix to this paper I present a model of the process- of 
knowledge organization and utilization based upon the interaction between the 

societal knowledge base and humans, either as individuals or groupsj it is 
characterized by the summary title "an information-agent interaction model," 
The model has the characteristic that it accommodates within one framework the 
three major change models identified by Havelock (l97l): research and 
development, social interaction and problem^ solving. Each of the change models, 
when viewed in this framework, appears to be characterized by its assumptions, 
made as to the source of change processes; these sources are, respectively, 
increase in usable knowledge, knowledge distribution and assimilation, and 
(self-) organization of user needs. 

The information-agent interaction model is presented, not because it 
is assumed to be The Model of knowledge utilization, but because it parallels 
the accommodations made by public policy on research and development in recent 
years: without abandoning the concept of rational change based upon the 
planned development and exploitation of knowledge resources, public policy 
has tended to add to this process by focusing on interventions aimed at 
penetrating the user system, viewing- the processes of social interaction and 
problem-solving as delivery mechanisms whose characteristics should be taken 
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into account when organizing the R&D process or, where circumstances perniit, 
manipulated to suit the objectives of the R&D process. The author is convinced 
that the practice of research and development in education will have to go 
much farther in accommodating itself to change processes in the educational 
system, if it is to be an effective instrument of social policy; in other 
wordB, the concept of research and development will have to be re-defined to 
include a dimension of social receptiveness to change as one of its integral 
goals and modes of operation. 

Two major implications of the information-agent interaction model should 
be kept in mind during the discussion that follows: . 

(a) The distinctions between "researchers", "developers", "change agents", 
"linkers" and "users" are useful role categorizations for visualizing functions 
within specific types of research and development, but they do not apply to 
all modes of development. They are, so to speak, language conventions based 
primarily upon the perceived ends or objectives of activities, not upon essen- 
tial differences in the basic process of the activities. Above all, there 
is no implied division of labor between persons or agencies following the 
lines of these distinctions, (b) Sinco organized, fonnalized scientific 
research is only one of the means by which the societal knowledge base is 
increased, research is not to be perceived either as the sole source of change 
or the sole source of knowledge inputs to the R&D process. 

In combination, these implications have various side-effects, the most 
important of which is to put the role of the researcher into better perspec- 
tive, probably reducing its significance by comparison with the perception 
of members of the research commimity but still maintaining it in a more central 
place than public opinion would assign it, at least for applications to education. 
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Using the model as an instrument for visualizing the boundaries of the 
H&D system, one if faced with an important choice point. If one looks at 
the process from the research end, so to speak, attempting to determine how 
basic research eventually reaches practice, one gets a very limited view, 
one very close do the models of research and development prevalent in fields ». 
such as cancer research, where extreme emphasis is placed upon unravelling 
certain basic biochemical processes of the human organism; in the end, however, 
it is obvious that, in the public health system as a whole, cancer is only one 
of a number of potential causes of death and, even if a cure could be found, 
there would still remain massive problems of organizing the delivery of health 
services to the population as a whole. The problem is a direct analog of 
research end development problems in education: the physical well-being of the 
population i§ as difficult to improve as the level of education, and as depen- 
dent upon individual choice and circumstajice (except that law forces part of 
the 'popiolation to accept education but does not reqxiire visits to the doctor). 

If one turns the model around and considers it solely from the point of 
view of the ^aser, a similar distortion results, only in the opposite direction. 
Instead of being too narrow, the view is too diffuse. The knowledge applied 
by any "user" of H&D is ordinarily based upon the entire cultural knowledge 
base available at any given time; popular myth or local circumstance may be 
more important at a given moment than the results of recent discoveries of 
science. The true believers in RSJ) react immediately and instinctively 
against legitimating such a diffuse process; they reject the idea of tinkering 
at social change without a systematic or scientific basis, though this is 
historically the main way in which social change has occureed. Intuitively, 
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one has to agree with them: any application of knowledge is not necessarily 
R&D. Conversely, one also senses that R&D cannoo be limited so that it includes 
solely the use of scientifically "proven" knowledge, since this would imply 
that science has found the answers to all problems that will be posed. This 
is manifestly incorrect. 

The practical problem is to reconcile the two extremes of accepting basic 
scientific research as the only source of \xsable knowledge or accepting a 
system in which the results of methodical research are given little or no 
importance. To be precise, the agent- information interaction model permits 
us to describe situations in which scientific knowledge is found without intent 
or immediate probability of application as well as those in which social 
or other change occurs without conscious or explicit reference to a 
scientifically established knowledge base. Within the broad range of possible 
situations fitting within the model, we shall define R&D as the systematic 
attempt to manage or improve the efficiency of the flow of scientifically 
established knowledge into use . This definition hinges upon the operational 
sense given to the words "systematic attempt" j depending upon who is applying 
the yardstick, the measure will be broader or narrower. It is an obvious 
corollary of this definition that educational R&D is the application of R&D to 
improving the flow of scientifically established knowledge into use in 
education. Here, the obvious hinge word is "education." Again, its meaning 
will have to depend upon the user. In proposing to use this model of R&D 
as a basis for expanding the boundary of the national educational R&D system, 
we shall have to pay particular attention to these two concepts. 
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If the begirniing point of the concept of educational E&D is education, 
the focus of education is the learner. Let us define the education proceL 
(as opposed to the "education" or culture" comunicated to the learner by the 
process) as the systematic organization of learning experiences. The defini- 
tion will hardly do for a learned treatise on the philosophy of education but 
it is certainly congruent with moBt of what we all mean when referring to 
education and includes a lot which is frequently overlooked in practice. Let 
us take a simple example: a recent survey of literature on change in the 
school system by Fullan (1973) found that most articles concerned with the 
question of how the user viewed R&D and applied it in practice tended to 
equate the "user" with the teacher or educational administrator employed 
full time in the school system. Rarely, if ever, was the learner or pupil 
viewed as the user of educational R&D! For the moment, we should retain 
the notion that learners exist in other settings than the publicly-supported 
system of schools and colleges of the nation. As we set about exploring the 
boundaries of the educational R&D system, each area explored will have 
associated with it a body of learners whose learning experiences are the "target" 
so to speak of education R&D. 

2* The publics for educational R&D 

The basic stratagem for "expanding" the concept of educational R&D is to 
look more broadly at the types of educational experience served by the R&D 
activity. At the present time, most of what is recognized generally in the 
United States as educational R&D serves the educational sector symbolized in 
the following diagrajn: 
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Certification-oriented 
State Private 



This sector of education is what we refer to generally as "public educa- 
tion": the k-12 system with its extensions, in one direction to include 
pre-school programs, in the other to include colleges and degree-granting 
post- secondary institutions (including professional and graduate schools). 
Though some institutions are state-supported and others derive their 
income from private sources (churches, private donors), the system is 
generally viewed as a whole for most public purposes, such as the defini- 
tion of educational R&D programs. In practice, the post- secondary sector 
is usually not thought of when speaking of educational R&D. Such an 
exclusion hardly appears justified. When a federal agency such as the 
National Institutes of Health makes a grant to a medical school for the 
purpose of revising and improving its teaching program, it is subsidizing 
an important type of educational R&D. Since large numbers of other types 
of institutions grant vast numbers of certificates and diplomas different 
from those of the sector just described, we should perhaps clarify the 
title to say explicitly "primary certification." (Though many persons leave 
the system and return later to complete their studies for a given degree or 
level, most structures are clearly oriented towards the concept of a 
sequential system providing initial training to younger persons prior to 
entry to the economically active population). 
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The primary certification sector can be opposed (rather simplistically, 
it is true) to the task-oriented education sector, as symbolized in the 
diagram below: 

Primary certification Task-oriented sector 

sector 

State Private State Private 



The title chosen for this sector is not intended to suggest that the primary 
certification sector excludes trainiiJg in Specific tasks or professional duties 
it is simply a short title for a complex reality. The sector includes 
generally those types of education programa organized for the purpose of 
helping a person to carry out a job; though not always 5 the programs are 
generally conceived as following on from some level of general education 
obtained in the primary certification ser».tor. There is no implication that 
the content of the courses deals with narrowly-defined trade skills: foreign 
Itoiguage training programs for Peace Corps volunteers, special general culture 
semi7;ars for executives in need of "'broadening", sensitivity training sessions, 
aJl fit in the category easily. Most of this sector is overlooked in 
di^cusoing or planning educational. R&D for the. purposes of governmental policy; 
the only areas specifically included are tae in-service training of teachers 
employed in the primary certification sector (either in-service training in 
geaeral or dissemination programs aimed at the teacher as an adjunct to H&D 
programs directed, at the classroom) and the training of recruits into special 
governmental progr^s (Peace Corps, certain poverty prograins). The areas 
generally ei;:cluded i^i^e: internal training programs of employees in the private 
sector, most . interna], training of public employees, training programs of the 



60 



35. 



military. The fact that these areas are seldom thought of as part of the 
clientele base for educational R&D does not moan that there are no E&D 
activities underway initiated within the private sector and the government. 
In fact, the amount of systematic, highly organized program development in 
these sectors is probably much greater than all that is done in the name of 
ejiucational R&D for the primary certification sector. 

What is more, this is true if one limits the idea of education solely to 
the presentation of systematic classroom programs or some variant of them 
using electronic or audiovisual media. If one also includes the private sector 
analog of what is called "general culture" (or something like that) for the 
primar:'' certification sector, then the balance shifts drastically. Here I am 
referring to the question of employee information programs intended to keep them i 
to date with the state of the art in their field, particularly as regards changes 
in technology and products. The problem is an enormous one of in-service 
retraining, frequently involving a combination of numerous methods within a 
carefully planned framework. Some major industries — the computer industry 
is particularly well known but not imique involve periodic technological 
upheavals that require the nearly complete retraining of a majority of the 
professional work force. The success stories of certain firms which are 
successful in their internal retraining programs for technological change 
should not blind us, however, to the certainty that there are at least as many 
failures, marked by the human "dropouts" from economic sectors where the 
replacement of the humans involved was either implicitly or explicitly the 
consequence of inadequate internal training mechanisms. In a society verging 
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on the welfare state, there is no certainty that the final cost equations 
based on lower training costs within the enterprise are not coimter balanced 
l>y other social costs measurable in financial terms, quite independently of 
the humanitarian problems involved. This means, essentially, that the 
"task-oriented sector" defined here is both: (l) one of the largest producers 
of educational B&D in the nation (even by narrow definitions of R&D) and (2) 
one of the major areas of need for further educational E&D. As such, it has 
a place of privilege in any expanded concept of a national educational E&D 
system. 

It is axiomatic ajnong professional educators that education is not 
solely preparation for a job. The broader definition of educational goals 
to include personal development and fulfillment leads us to point out that 
the sectors discussed thus far amount to formal education. In order to be 
complete, our diagram should look as follows: 

Formal education 

Primary certification Task-oriented sector 

sector 

State Private State Private 

Informal education 
State Private Cooperative Familial 

Our earlier definition of H&D included the terms "systematic attempt to 

manage or improve the flow..." The reference to "systematic attempt" carries 

with it a strong connotation of an institutional base: Does this exclude 

informal education? Certainly it excludes a good deal, particularly the 

individual learner's attempts to improve his own lot by organizing his leanaing 
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experiences more effectively; that he could do this in a systematic fashion 
making use of scientific basis is not denied; it only appears to be too big 
a problem to deal with here, too diffuse to be of interest for the immediate 
future as part of a national H&D system. But, to say infonnal, does not 
mean non-institutional. There are numerous state- supported institutions 
whose main role is to foster individual learning: libraries, museums, art 
galleries and numerous other institutions that cater to the general cultural 
(with or without a capital 'C') needs of the population as a whole. Much 
effort is also put into enterprises that are labelled with titles such as 
"public information programs" (e,g,, on personal health problems) or 
"consumer education"; these fall clearly within the requirement that there be 
an institutional base. Systematic attempts to devise better techniques for 
these programs using the fruits of scientific research on media effectiveness, 
for example, would probably qualify for almost anyone's definition of educa- 
tional R&D, provided one does not limit the scope solely to formal 'schooling' 
techniques or the education of the yoiong. There are also, of course, 
numerous private enterprises of a commerical nature which serve the varied 
needs of the population for information and learning experiences. For 
purposes of clarity, we will classify these under the category of "private", 
using the categories "cooperative" and "familial" to deal with two other major 
realities of the informal sector. Cooperative non-profit organizations of 
many types are involved in educational endeavours of the most varied sorts. 
The family remains the -basic element of infonnal learning by the yoiang and, 
particularly, the very young; that there is much which is traditional in 
child-rearing practices does not exclude them from being the objective of 
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systematic scientific study aimed at their improvement. Public policy on 
educational research and development may choose to ignore informal 
education altogether or various parts of it; but to do so is to ignore also 
the major portion of the learning experiences of the majority of the 
population, * 

3» Boundary criteria 

This discussion of groups served by education, broadly defined, has led 
to an expansion of the potential system boundary of educational research 
and development to include most of the information processing and creation 
capacity of society. At some point, it is necessary to begin establishing 
boundaries. Our problem arises, in this respect, from the fact that our 
society is pluralistic and we must therefore assume that the definition of 
system^undaries will evolve over time in relation to shifting goals. This 
has been pointed out in a recent article by Eide (1971) in the following 
terms: 

In terms of goals, it is fairly generally accepted in principle 
that the goals served by education are not exclusively "educational" 
Most social goals are influenced by educational activ:Lties. On the 
other hand, m hardly any case is education the only activity serving 
those goals. It is virtually impossible to establish a set of 
independent goals for educational policy. When attempted, it leads 
to disregard of essential consequences of educational activities, and 
of non-educational factors influencing the stated goals. 

Under these circumstances, the best we can hope to do is to establish very 

general criteria for selection of system components, aware that any concrete 

*Lt is symptomatic that the education reform law recently adopted in Peru 
gave explicit recognition to informal education on a legally equal footing 
with formal education and defined as one "mode", of informal education the^ 
family, primarily with reference to infants. 
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application of this framework will ix.TOlve specifying more precise boundaries, 
A set of general criteria are proposed and then a number of specific problem 
areas are discussed; one of these areas, that of media and message systems, 
is' of such dimensions that it is dealt with in a separate section. 

The general criteria can best be visualized as partially or wholly over- 
lapping circles, in the symbolism of Venn diagrams: 



Insert Figure 16 about 'nere 



The first criterion, symbolized by circle A in figure 16 , is by far 
the more general; it refers back to the definitions given above, namely that 
we should include only activities related to education: 

cl) Relationship to the needs of an identifiable educational 
public (i.e. to one of the three sectors referred to above: 
primary certification, task-oriented and informal). 

Within this domain, one can look for organizations whose activities are 
intentionally geared to serve the educational needs of those groups; this 
may apply either to a private school or a public school, to a private business 
firm selling, for example, textbooks, or to a state agency developing public 
information programs. The bulk of the activities carried out in such 
organizations is probably not what one would wish to consider in any narrower 
definition of R&D, certainly not in one which makes reference to usage of 
basic research inputs as part of the process. Nevertheless, from the point 
of view of potential for R&D, these institutions constitute a field where 
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organizational change and shifts in modes of operation might occiir in the 
direction of greater capacity to carry out B&D, narrowly definedj the 
implications of such change would be enormous. What is more, in almost all 
cases some B&D is being done, even at present. For the purposes of 
monitoring on a national base, they have to be included, even though the moni- 
toring will reveal only a small proportion of activities fitting a narrower 
definition of R&D. 

C2) Those institutions having as a major activity the education of 
an identifiable educational public should be included as 
potential sources of RSsD for the purposes of monitoring. (This 
is symbolized by Circle B in diagram ivAl). 
Two questions arise: (1) How does one determine which activities inside 
educational institutions constitute R&D? (This is symbolized by the overlap 
between Circles B an<i C in Figure ivAl). (2) What educational R&D goes 
on outside the framework of educational institutions? (This is symbolized 
by the portion of Circle C which does not overlap with Circle B in Figure 
ivAl). To determine this, a set of criteria are required which center 
around the concept of what constitutes an R&D activity. As bases for select- 
ing activities for inclusion within the concept of R&D activity, four types 
of criteria appear to be in use, either singly or in combination: 

C3a) Generalizability of activity results: The applicability of 
results to more than one user, more than one situation. The 
definition of generalizability is frequently dependent upon a 
corollary assumption, that research results derived in a 
"scientific manner have wide applicability and are not case- 
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specific. This corollary may be useful for certain applica- 
tions, but not all. 

C3b) Conscious use of a particular methodology of work: the concept 
of "disciplined inquiry" as broadly defined by Cronbach and 
Suppes (1969) constitutes a criterion of sufficient generality 
to be applied to most situations required in defining a national 
monitoring fraraework. 

C3c) Durability of results: many current definitions of R&D as a 
change-oriented methodology obviously imply the inclusion of 
information systems and the general "delivery capacity" for 
effecting change, including the mechanisms used for planning 
change (defining goals, specifying objectives, selecting means, 
etc.). Obviously, all planning systems and all information 
systems are not part of any current definition of R&D, so that some 
criterion of selection is required; the most useful, when applied 
in conjunction with other criteria, is that of durability of 
change being sought. 

C3d) Novelty of an activity or its results: the basic definitions 
of R&D used for the survey of the National Science Founda- 
tion (cf . NSF 1972 p. 39) exclude activities which are 
"routine," such as product testing or experimental production 
from the definition of research and development. This is in 
general agreement with international practice. For example, 
the Unesco surveys of R&D also exclude "routine" activities 
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from consideration and define "experimental development" as: 
"Systematic use of the results of fundamental and applied 
research and of empirical knowledge directed toward the intro- 
duction of new materials, products, devices, processes and 
method - or the improvement of existing ones - including the 
development of prototypes and pilot plants" (cf. facsimile 
questionnaire. Freeman 1969b, pp. 41-42). The phrases under- 
lined (by the author) indicate the emphasis on novelty, which 
is amplified in the OECD guidelines for surveys (OECD 1970, 
para. 31, p. 12): "The criterion for distinguishing R and D 
from non-R and D activities is the presence or absence of an 
appreciable element of novelty." 

The intent of the definitions quoted is to assure that 
"scientific" activities are not confused with the mundane 
world of day-to-day production, administration and instruction. 
The affect, when applied to educational R&D (broadly defined) 
is to remove from consideration numerous areas of crucial 
importance, if R&D is considered as a mechanism for changing 
educational practice. For example, evaluation of educational 
products prior to adoption decisions is excluded from msf 
surveys of R&D, as are activities related to iafoririri. potential 
users or adopters about new products; the whole range of 
activities usually grouped under titL^s such as "dissemina- 
tion" or "linkage" and "implementation" is excluded. (A small 
portion of these a'.tivities is included as "other scientific 
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activities" in broader NSF surveys, cf. NSF 1971). From this 
cf is clear that the criterion of novelty is primarily useful 
for separating out within the broad spectrum of R&D activities 
thou wh:V, are clasest to a narrower, science-based conception 
of R&D. 

The use of these criteria is no easy matter ajid must obey a nuniber of ' 
specific constraints in any given application. Various systems of classi- 
fication hav.^ been proposed which deal uith the application to school systems 
either as regards the definition of innovations in schools (cf. Havelock 1970 
and literature cited above) or as regards research and development activities 
(Brickell). Major definitional problems arise at the two extremes of 
the R&D flow described earlier, the question of general social science 
research and the generalization of the educational R&D framework to the 
non-educational agency. 
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4.) Special case one; 'Basic' research 

It is an article of faith among some scientific circles that basic 
research is 'purer' the less anyone can define a use for the results. If, 
by def initio:,, R&D requires that there be something called "educational 
research", how does one go about defining it at the basic end of the spectrum 
without including the whole range of the social sciences? As the paper by 
Eide (1971), cited earlier, phrases it: 

..it is sufficient to state that research needs emerging from 
educational activities go far beyond what can be met by "educational 
research" as defined in most university settings. This implies 
that the relevant research instruments are not specific to 
education. . (p. 25) 

Relating the definition of educational research to policy initiatives raises 
even more fundamental problems. To quote Eide again: 

What appears to be high efficiency in research performance may thus, 
m fact, reflect inadequate formulation of sub-goals in the field 
of policy concerned. A proper formulation of such sub-goals in 
terras of a general goal structure of society might prove that the 
present answers provided by research are not only insufficient, 
but even misleading, (p. 26) 

Faced with the awesome choice between including all of the basic 
sciences in the system and thereby making it impossible to monitor or using 
a limited definition and thereby risking leaving out entirely some research 
area whose results may be eventually earthshaking, one is obliged to choose 
the latter„ The criteria to be used will obviously be linked to perceived 
applic-ability to education, so that the types of research included will be 
primarily applied, rather than basic. The exception would be the case where 
a research institution's activities are included en bloc on the grounds that 
the Institution is specialized in educational research and some basic research 
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happens to be maintained (or bootlegged) in the institution. The criterion 
here becomes: 

C4) Research activities will be included which are pf perceived appli- 
cability to educational problems as currently understood. Basic 
research in social sciences dealing with problems not currently 
preceived as educational will be excluded. 

As with other criteria, this one will require the development of 
operational definitions for classifying data in specific cases, 

5) Special case two; non-educational institutions 
The generalization of educational R&D concepts to the framework of non-educa- 
tional institutions presents a number of difficult problems. To begin with, 
the institutions themselves rarely conceive that the tasks they carry out 
involve an ''educational'* component, unless the training function involves the 
use of a formal classroom situation, ^Education' and 'schools* remain 
inextricably intertwined in the consiciousness of most persons, "Vocational 
education*', even carried out in classrooms, frequently is relegated to a 
place of illegitimacy by using some catch-all phrase such as "training" or 
"skills training" to distinguish it from the world of "educationg" While 
the debate is both philosophical cUd practical as to the relative values to 
be placed upon these views of 'education', a national monitoring framework 
cannot afford to take sides; it must recognize that two sides exist (or 
however many sides appear appropriate in this context) o In a large number of 
cases, the criteria mentioned earlier (point 3, sub-items a,b,c) can be 
applied to determine whether an activity "qualifies" as R<ScD, The following 
problem areas seem noteworthy: 



46, 



a) With regard to "generalizability", one is forced to note that many 
situations in public institutions and private busin- sses are unique. 
To take a straightforward example: The Department of Defense may 
have designed a new weapons system requiring the training of several 
hundred persons under conditions of "quality control" unparalleled 
in the public education system; in order to achieve this, very highly 
sophisticated techniques may be needed to create the training system, 
and these techniques would be instinctively recognized as being 
those used (perhaps less efficiently) in R&D for public education; 
yet, are the results "generalizable"? The system will certainly be 
used in only one establishment, within one institutional framework 
and, in that sense, is not generalizable. In order to include it, 
the classification scheme will have to be based upon weighting of 
other criteria, such as methodological rigor ("disciplined inquiry") 
or some specific teaching characteristics such as the likelihood that 
the system will work almost independently of the human "teachers" 
involved (if any are at all, which is not altogether certain in some 
types of training), 
b) Organizational internal information systems are not the direct analog 
of a 'dissemination' function in public education; the latter is 
intended to keep an educational practitioner informed. The business 
information system that would qualify as part of the "task-oriented 
education sector" would be analogous to a diffuse classroom situation, 
as the recipients are perceived as the final learnr>i:s in most cases. 
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Y*>t:, obviouriyj nost b:jnincii;s r.nd public ampLoyucs regularly 
receive n multitude of messages such as IcitLcrs, memoranda, 
circulars and telephone calls, none of which would really be 
deemed educative ir even the most narrow vocational senseu Still 
th'^re are businesses which plan, for example, selective dissemi- 
nation of information systems which keep professionals up to 
date in their areas of work; the educational function of the 
systems is indisputable, and the artifices that go into their 
design, implementation, evaluation and improvement are 
indistinguishable from the tasks carried out in what one would 
recognize as traditional educational R&Do The line is hard to 
draw and will require the development of specialized taxonomies 
based upon overlapping considerations: 
C5a) The degree to which the information function is task- 
specific or skill-specific (to coin a pair of phrases): 
"Task-specific*' information is related to the task at 
hand and does not have as an intended, outcome the develop- 
ment of skills generalizable to other tasks; "skill- 
specific" information would have. as its objective the 
development of generalizable skills. Skill-specific 
information would be the underpinning of both "specific 

training" usable only in the same firm and 

"general training which raises productivity of 

the worker irrespective of which firm he works for to 

borrow Liic ciistLnction m;ule by Becker (I96'^0. ^^^'^^ highly 
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useful indicator is the degree to which the messages in the 
system have a personal content, i.e. whether messages are 
addressed to the employee as an individual (task-specific) 
or as a member of a class (skill-specific) and whether 
the message origination depends upon the initiative of an 
individual or is the result of a systematic procedure^ The 
design of routine data processing systems for administrative 
purposes would be similarly exlcuded; the "gray area" would 
consist of the business system having special informational 
sub-systems built around a data-base concept; inclusion or 
exclusion would presumably be based upon an analysis of the origin 
of the data and its usage, but any classification scheme is likely 
to be arbitrary in the extreme under these circumstances. 
C5b) The methodology used in developing the system: The formulation 
of the objectives of the information system, particularly if 
they appear to be of a general nature, would be one of the prima 
facie indicators of the nature of the information system; recourse 
to methodologies recognizably applied in development of educa- 
tional systems in other sectors (specification of objectives for 
learner performance and parallel development of testing instruments 
by formal procedures as a means of assessing system or learner 
performance, for example) would be useful indicatots. 
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These definitional problems are confounded in many situations by the 
fact that the organii^.a Lions involved, as mentioned earlier, arc unaware of 
the nature of their training functions and would seldom classify them according 
to the categorization outlined above. Gathering information on such activi- 
ties may be extremely difficult except in the very larp.e or very progressive 
enterprise where employee development is a recognized, differentiated activit 
There are two possible attitudes that one may take to this situation. The 
first, phrased colloquially, is "that if they don't know they're doing it, 
they ain't»'' R&D is usually conceived of as a consciously planned problem 
solving process; the structure is a useful guide to follow in deciding whether 
R&D is occurring, except where it is occurring and the organization uses 
some implicit differentiation between ''education" anc ''training** to exclude 
it from consideration as educational R&Du The second attitude is based upon 
the converse: "If it's not being done, it probably should beo" There are 
many situations in which important educational needs exist but are unrecognized; 
there may be, objectively, an unmet need which, with some change in circum- 
stance, will be recognized and dealt with through R&D, Between the two 
attitudes there is a gap in definition of what the R&D system might 
include: it is the supply or production of R&D, then the first attitude 

should prevail; if it is the demand or need for R&D, then the second attitude 
seems more appropriateg We shall return to this problem in the 
of the paper as part of a discussion of what is meant by a market for R&D. 
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B. MEDIA AND MESSAGE SYSTEM 

The knowledge creation and utilization process described in the 
previous section is dependent for its operation upon the existence of 
a comnunications capability; in our society this capability is dependent 
upon an important technological infrastructure. Although the communi- 
cations infrastructure overlaps in large measure with the knowledge 
creation and utilization process, it is not exactly congruent with it, 
and the analysis of specific media and message systems provides a 
somewhat different dimension of study. The expansion can be symbolized 
by the addition of a fourth circle to the Venn diagram used earlier: 



\. Insert Figure I7 about here 

We shall discuss briefly two potential ways of using this 
concept for expanding the R&D system: (1) analyzing media pro- 
duction and delivery systems in the sense of a raw delivery capa- 
b....i-.y for the medium and then (2) isolating specific major media 
systems of importance for educational R&D, 

J-» Media production and delivery systems 

In discussing media production and delivery systems, we refer 
both to the production and delivery facilities , in the sense of 
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equipment, and Lo the persons or organizations employed in operating 
the equipment. For convenience, it is perhaps best to discuss 
separately telecommunications media and • .her media. The two can be 
employed jointly on the same educational task, but at present they 
are generally organized separately in this country© 

The potential of radio and television for educational purposes 
is much talked about but less frequently applied. It should be 
clear from experiments like Sesame Street that it is possible to 
design their content in a rigorous, carefully evaluated framework 
that fits under most definitions of educational R&D. The problem 
is, therefore, not whether to include these media and the related 
infrastructure in our expanded definition of the educational R&D system. 
It is rather to decide what portions of the total infrastructure of Che 
country do not fit within it. Broadcast television constitutes a major 
portion of the nation ^s total cultural environment, one which impinges 
upon nearly every^-household. In addition, the standards applied for 
the design of programs are rigorous in the extreme, at least as regards 
their media envelope. Yet, even by the most broad standards of educa- 
tional intent, the majority of commercially broadcast programs do not 
constitute educational television. For practical purposes, therefore, 
it is necessary to develop a criterion of exclusion: "Educational" 
television and "educational" radio should be included as part of the 
educational R&D infrastructure; generally speaking, these concepts 
will not include the preparation , or distribution of programs intended 
primarily to serve as entertainment, defined as dramatization of 
fictional events, or primarily to facilitate delivery of commercial 
marketing messages. 
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Although not usually thought of as part of telecommunications 
media because most current use is geographically limited, computer 
assisted instruction systems should also be considered in the defi- 
nition of message systems used for educational R&D, The only defini- 
tional problem involved in this respect is the need to exclude routine 
administrative use of computers. Although many communication networks 
have been built up for such administrative purposes and are, poten- 
tially, applicable to educational use, the only ones what should be 
included as part of the R&D infrastructure are those v^iich have jeen 
effectively used for this purpose for a certain period of time. The 
program production capability associated with such systems would be 
subject to the same criteria as other types of educational R&D; 
individual teacher usage of these systems in the absence of systematic 
procedures for program development would be excluded by most definitions, 

1When one turns to the question of media production capability for 
media not distributed via telecommunications, similar problems arise. The 
educational textbook industry is the major factor currently affecting 
the content of teaching in our educational system. The print medium 
is definitely "in" our expanded concept of the RiD systemV the question , 
is which part of it should be excluded, (It should be noted in passing 
that most commercial publishers of educational materials provide a 
range of non-print materials in the form of films, slides, etc,; 
these are understood to be included in this discussion). The vdiole 
fiction publishing industry might qualify under one definition, since 
there is obviously a lot of fiction having liter^y or educational 
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mt»riL; the general production and distribution of factual lafomiation 
in any substantive domain is also potentially ^'educational" 

The only solution appears to be to begin with a very narrow 
definition and expand it only the amount necessary for practical 
purposes. Publishing activities directed toward the public education 
system and persons studying in it, should qualify; so, also, should 
publishing aimed at providing the individual learner with carefully 
structured self-instructional materials marketed on the basis of 
their educational value. (A detailed taxonomy would be required for 
any specific application of these criteria). 

What portions of this media production system, so ^efined, 
constitute R8tD in a rigorous sense is subject to question© 
publishing industry provides a great, but unrealized, potentia. .or 
systematic R&D, This potential exists despite the fact that most of 
the textbook publishing industry usds artisanal methods comparable 
to cottage industry in the general manufacturing domain© To be more 
precise, the physical manufacturing of textbooks and other teaching 
aids is organized using the latest industrial methods. However, the 
quality control involved is exercised mainly over the medium itself: 
"qljality^bf graphic designs, typography, grarr^ar and syntax of text. 
Only minimal standards are applied to the content itself, at least 
as regards the impact on the learner. In summary, when one includes 
non-telecommunications media in the definition of the R&D system, only 
that part which is directed toward structured, forma d educational 
experiences should be included. Since even that portion is generally 
somewhat removed from the concept of systematic research and develop- 
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ment, its inclusion is justified only in terms of its potential 
rather than its accomplishments, 

2, Specialized information systems 

The author is unaware of any taxonomy which adequately 
categorizes axl types of information systems, as these span the 
whole range of potential human activities. For want of a better 
taxonomy, the discussion that follows will be based upon a rough 
distinction between (1) public-access systems and (2) transformation 
usage systems. The first set of systems are those which are intended 
to provide access to information for a general class of users, such 
as the public in general (libraries), university biochemistry 
researchers (a scientific abstract service), etc. The second set of 
systems is generally those which are intended to transform knowledge 
into forms useful for solving specific problems. The distinction cannot 
be made always, but it adequately serves to categorize most relevant 
systems. 

The only way that I can visualize for developing a list of 
information systems suitable for inclusion in an educational R&D 
system is to begin with a definition of user publics and work 
backwards, determining whence they obtain their information and 
then deciding upon the relevance of the systems involved. Since 
such a study is obviously not possible within this paper, I propose 
to limit myself to a few general remarks. 

Out of the whole vast domain of public access information 
'systems, any likely monito;:ing system will have to be extremely 
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limited in it.s t:hoicc. In all likelihood, the niaiii systcMus 
to be considered initially are those which receive state support, 
such as the public library system and public information systems 
of federal agencies for the public at large in the inf onrial/education 
sector; selected professional publications for educators in the 
task-oriented education sector; and, for the public education system, 
a somewhat larger selection of systems. Of the information networks 
serving the public education system, one should definitely include 
the Educational Resources Information Center (ERIC) system, professional 
education journals and systems intended to assist the in-service 
training of teachers and administrators. The ERIC system, wliich 
dwarfs in size any other educational information system, has two 
characteristics which should be mentioned: (l) t should not be con- 
ceived of as an entity limited to the data base and processing system 
(clearinghouses, production facilities, etc.) supported by the U.S, 
government; it is the '^front end" of a much larger information system, 
an enormous scientific and popular press infrastructure which is, of 
itself., a part of an expand educational R&D system concept* (2) he 
facilities provided within the system include, at least on a limited 
basis, functions which are close to those described below as part of 
transformation and utilization systems: query negotiation, search, 
retrieval and transformation (synthesis, analysis and interpretation)o 

Because of their relatively large influence but limitod numbers, 
professional, full-time R&D personnel (narrowly defined) constitute 
a public whose needs deserve to be studied carefully on a regular 

83 



56- 

basis. Although they are mang the prime users of formalized information 
systems such as ERIC, ir clear from the history of scientific 
discoveries and the general lore on how personal decisionnnaking 
operates, that the study and ^^^^elopni :r of information systems 
for this group of people mt include informal communication 

(a»id prestige) networks. 

An obvious point to be made about public a ^ ss information 
• is that the whole formalized educational process in the public 
schwci system is the largest information system in the category. For 
obvious reasons, it is not included per se in the educational R&D 
system but certain aspects of it should be, particularly the formal 
education of educators© 

By information transformation and usage systems, I am 
referring to a broad class of mechanisms by which users of informa- 
tion transform it in order to adapt it to their own needs. A 
straightforward example of such a system might be the way that a 
school district obtains information on, say, demographic conditions 
in the area and joins it with other information regarding current 
resources to predict potential shortages of classrooms. In general, 
these systems encompass the whole range of processes by which information 
is treated for the purposes of decision-making and action. The level 
of analysis can range from the very broad (e.g. legislative decision- 
making) to the level of the individual-, From the point of view of 
an educational R&D system it is extremely important that these systems 
be included, particularly at the level of the operating educational 
management and implcmentatiov. unit, the school district and the 
school, for the K-IZ system. 
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The study of LnPormation trans f orniation and usage systems 
in education is still an rirt in its infancy. Almost intractable 
problems arise from the complexity of the data available. Formally 
established mechanisms for processing and ising inf ortnation are 
frequently overriden, in terms of influence on actions, by informal 
interpersonal chains of information, whose analysis may require 
methods derived from psychology, anthropology and information science 
Though monitoringv on a continuing basis is a patent impossibility, 
these information systems and chains of decision-making are at the 
very heart of the whole question of whether educational R&D is an 
effective method for introducing beneficial change intc any aspect 
of education. They are deserving of study in order to determine 
how existing systems work (as opposed to how they are said to work). 
Development of prototype systems working more effectively (however 
defined) than current ones constitutes, or should constitute, a 
recognized branch of R&D activity. It may well be that the 
institutionalization of systematic transf or:aat ^.on-utilization 
systems within existing "user" organizations for R&D will prove the 
basis for a different conception of R&D as applied to social problems 
a conception more powerful in its implications for change than a 
massively subsidized, industrialized R&D having its institutional 
base separate from the "user" system. 

The case has been made lor including information transformation 
and utilization systems in an expanded model of educational RcJ), at 
least from the point of view of potential. The practical problem is 
turning that pote.tial into a realityo 
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C, RE SOURCES 

In this section we shift our framework of discussion to consider 
the educational R&D system as an economic activity requiring resource 
inputs. The means by which those resource inputs are created and 
allocated do not constitute educational R&D by any definition, 
yet it is clear that the whole enterprise cannot survive without 
them. Unless they are included in the expanded system, it will 
not be possible to explain adequately crucial aspects of l^s 
operation. 

Three types of resource are of importance for R&D viewed ?s 
an economic sector: people, money and equipment, Al<:hcugh fina* 
investment, or money, can usually 'buy' tiie othr.i i<i sources of people 
and equipment, at a' y one point in time there are factors which mea;i 
that these different classes of resources are not immediately iiiLer- 
changeable; Money to pay salaries, for exar/iple, canno* rer idy a 
lack of highly trained research staff in a frontier discipl.fr?^ It 
is this scarcity property of resources (including money) from 
derives their interest for policy-making and an^ily^is, Separdting 
them out as individual items for study does not Trn;> .y that tha-^r do 
not interact; quite the contrary^ none is conceivctile without trc 
others. The discussion below presents relatively si;^iple dcscripLiv- 
models of resource input flows to R&D activities, they are Sbbjccr. 
to elaboration (that is, through introduction ot greater Ic si", 
detail either by subdivision of the elements in rhevi o?: addil."*on oi 
;."w elements) but suffice for extending the concepc of <=ystem 
boundaries, 
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1 V Manp owcr 

The term "manpower^* is preferred in discussing the first flow 
because it is traditionally as^'jziated c^/lcn discussion of people as 
factors of production in economic life. The ir^ajor elements of 
scarcity are associated with two characteristics of manpower: (1) 
availability in terms of numbers and (2) skills in relationship to work 
to be performed. In terms of the R&D system it is important to note 
that we are not dealing with manpower solely as a production factor; 
Consumption of goods and irvices created by R&D processes requires 
that the consumer possess specific skills. To take a simple example, 
not always perceived by persons responsible for purchasing decisions 
in school systems, the intr duction of new media such as language 
laboratories into teaching practice requires that the teaching staff 
have skills not demanded in the usual classroom (not to mention the 
other users, the students)*, 

When manpov/cr supply is modelle.-. ;i terms of the two scarcity 
factors mentioned above, it is usually in terms of transiLion Lhrough 
a training or educational system, where passing through the syc^t-m is 
equated with acquisition of required skills. Let us examine the model 
type before dealing with its shortcomings. These models are baserl upon 
an "input'» of students and an '^^utput»» of graduates; at each point of 
transition through the training system, e.g. at the end of grades 
in a grade-proDot:ion system, one takes a measure of how many go 
on to the next phase, ^'passers", how many go back and repeat the 
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training experience, *^repeater>.>,*^ and how many have Left the training 
system altogether, ''Leavers." The following schema illustrates how 
a graph of such a system flow might be drawn to show the transition 
relationships: 



Insert Figure l8 about here 



In this hypothetical example, the nodes numbered 7,8 and 9 might be 
the grades in a junior high school. One might suppose that the school 
'•.ntake in a given year is 100 students into grade 7; of these 3 become 
leavers during the year and 10 repeat the following year, so that^ 
the original 100^ only 87 (100-10-3=87) go on to grade 8. (In the 
diagram, the values would be r^=10, 1^=3, o^=87). The only compli- 
cation in this calculation results from the fact that the total in- 
take in gi-ade 7 includes both new intake of 100 students plus the 
repeaters from the previous year. If thesc proportions were the same 
in the example for two successive years, the second year input to 
grade 7 would be 110 (100+10), the repeaters would Oa 11 (Iff/o of 110), 
the leavers (theoretically) 3.3 (3% of 110) and the passers 95.7 
(8% of 110); This illustrates the mechanism for calculating a 
prediction of throughput based on stnble inputs and stable t ;:ansition 
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Figure 18. Hypothetical flow model illustrating 
principle of transition through a 
graded educational structure 
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factors; in practice, inputj; vary and transition lactors vary, and 
living students either pass, repeat or fail in iiitegral numbers. 

The principle of such a flow model is very simple, which explains 
its utility for such purposes as predicting enrollment figures, 
particularly for large population aggregations where local distur- 
bances can be ignored in arriving at over-all patterns. For the 
purposes of modelling the R&D system, the model has important short- 
comings, deriving from underlying assumptions. Specifically, movement 
through r^uch a system is based upon some screening mechanism, such 
as a test, which is r./. z necessarily a good measure of the skills 
supposed to be taugh^; the test may be unreliable and/or invalid, 
and ius application may be completely '"^iased by circumstances (e.-. 
teachers' negative attitudes towards certain students miglit result in 
a measurable, "true" decline in performance on an othen-v^ise reliable 
test)^ V/hether one ii' discussing a single test or a whole process of 
certification in which a certificate, degree or 'iiploma is granted, 
the principle remains the sainr.: the criterion for passage through 
the system is not ne-pssarily correlated with the intended content 
of the teaching - stem» This principle has a sort of multiplying effcc 
when applied to th- second assumption, namely ..iiaL iiiic i;:tendeci con- 
tent: of the teaching syster.i is really relatcl io a joi^-skill (to limit 
ourselves solely to "his educational output Lor the present discussi. 
A final complication results from the structure of the systems usually 
modelled, name..-; t? ic level follows seciUL'ntial ly from the other 

a necessary rc iaticnsl-,ip: "You c^r'': :x^^ to ninth grade until you pass 
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the eighth." The model describes the way in which the system actually 
operates, thereby showing the poor fit between most sequential teaching 
systems and the actual process of learning. These shortcomings arc 
carried over into larger models of manpower training systems and 
manpower placement systems, which will be discussed next. 

The diagram which follows is an illustration of some of the major 
elements which should be included in a model of a skilled manpower 
supply system. For purposes of illustration, the model is divided into 
two major sections, the primary specialized training system and a job 
activity system involving training functions. Persons entering or 
leaving the systcuis are presumed to enter the general pool of manpower 
which may be considered to be roughly equivalent to the active or 
potentially active population at a given ti le. When tracing the actual 
experiences of persons with a given type of skill or v*ien looking at 
the history of a sin le individual, it is clear that (1) no part of 
the system elements can be considered to apply to all cases and (2) 
additional elemeuLS may intervei a. Above all, the arrangement of the 
"flow" ±3 not intended to suggest linearity, in. that most movements 
of individual persons are pres'-med to be mediated through the general 
manpower pool; job recruitment at any phase of a person's career is 
not presumed to require his having passed through the primary 
specialized training system; there is no presumed necessary relation- 
ship of training to skill or of skills and training to recruitment. 



Insert Figure 19 about here 
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Figure 19. Simplified diagram of flows in a skilled manpower system 
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Figure ,19. Simplified diagram of flows in a skilled manpower system (CONTINUED) 
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The major bcnefiL ol visualizing the manpower flow as a unified 
whole is that it serves to point out coiimon incorrect assumptions whir:]i, 
if noticed, are. seldom incurred* These might be summarized in point form: 

1, The notions of ^'supply" and "demand^^ are exactly inverse, 
depending upon the point of view. Decisions about setting 
up new training progrcims are frequently based upon a pro- 
jection of student ^'demand"; this "demand" depends in part 
upon the "supply" of student places available^ Conversely, 
a lack of trained manpower in portions of the job activities 
system generates a "demand" for persons which presumably can 
only be satisfied by an increase in "supply" of students. 
The important point to derive from these truisms is that 
there is no easily predictable link between the two types of 
demand/supply. Increasing tr lining opportunities may not 
increase even the number of recruits entering the training 
system, much less guarantee a flow of job applicants. 

2, The indirect relationship between the two systems and the 
considerable delays involved in most kinds of primary 
specialized training indicate the necessity of avoiding 
decisions affecting either system without careful considera- 
t:ion of how delays and svibsystem autonomy affect the 
assumptions underlying the decisions c 

J, The items in the job activities system labelled "learning 

the .-ob" and "additional specialized training or retraining" 
arc introduced in order to emphasize the following points: 
-That training prior to a job is seldom sufficient in 

itself and usually requires to be suppleruented immedi- 
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ately after recruitment, 

-That under ordinary conditions of technological change, 
many types of factual knowledge have a rapid obsolescence 
rate, requiring that retraining be considered a normal 
part of job life, 
4, A separate flow called "work output" has been indicated to 
emphasize that recruitment into work and even holding a job 
are not good criteria, alone, for judging the success of 
a job oriented training program. In some areas, such as 
basic research, short-term productivity after initial 
training or retraining is hardly a worthwhile measure of 
ef fectivenesSo 

From the point of view of "expanding" the system boundaries, one 
has thus far succeeded in clarifying two issues: 

1. The high degree of dependency between primary training and 
job activities together with the partial autonomy of each 
system means that definitions of either system are incomplete 
if they exclude the other system from consideration or 
proceed on the folkloric assumptions which are refuted by an 
integrated view, 

2, Although only briefly alluded to in this discussion, any 
attempt to limit the manpower system definition to a con- 
sideration of "producers" of R&D, in the strict sense of 
researchers or product developers or whatever, is too limited 
a view. There is every reason to include the "consumer" 



9 



65, 

a-, wnll, pnrliicuLarly w^lu'n asr^o r.r. inj.; r.'l.ntiivo scarcity, 
iji vic.v; c^i the fnctif thni .-.care Lt, i cs :;rr i «' nbl r Lo appear in 

areas wlu-rc change occurs rapidly and Lhat. tlicsc arc t:l^e areas vlior'-; 

obsolcf.ccncc of prior learning is liable t.o l^c liighost, an it;^pMria:U: 

ncv oniphasis atvpoars v/hcn studying inanpov;or systems: 

3^ On-t:he-joh or in-sci"vicc Lraiiiing systeias, including 
generallv learning during work experience, should 'ne 
spccirically included in virtiually every sysLeinatic 
sLudy of t:he R^VnNnaiipvtv.nT system^ In particular an eiforC 
sliould i'e innde to incorporate, v/herever possible, tdie 
clement of individual, se ll-d irccled learning experience!-.. 
There arc strong indications in the research literature 
that long-tenn output (as wel.1 as short-term success) may 
he related to individv.nl learning patterns and socializa- 
tion experiences r. ar norc than to the variables usually 
consLd'-rcd in drav/ing up policy options or models related 
to them, 

2 . Finance 

The modc^I of a linancial flow is oxtreivcly snnj^le and fam.iliar 
to all* a iM*.v*'S money to vlio allocates it t.'> several uses 
i:^, n and y^: 



In other words, ir-oney "circulates" over a period >l bime, and 
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Figure 20. Illustration of principle of 
fiDaucial flow 
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circulation can be Lraced ati a TLow. In Lhc Tic Id of Ris:!) on;' miglii 
vLiUializc a di-partmcnL of guvcirniurnt raich as the NllC a L l-ocni. Li-.g iuiuu* 
to a R&D laboratory, which uses the f.unds to buy services of resc<»rch 
personnel and the necessary equipment and other .Cacilities required 
to carry out activities over a period of time^ Generally speaking, 
:uonctary flovs generate associated ^activities' as well as further 
financial flows: 



Jj's-:rt Figure 21 about here 



A principal concern of most analyses of ^nancial flows will be to 
determine the relationship between monet^;r, nputs and activity 
out| utSo And, in most cases, the analysis wi.il deal x/ith the 
utilization of money by an institution such as a laboratory or a 
school system; but the j^^rinciple should be kept in mind' -that the 
analysis technique can be applied at different levels of aggregation, 
ranging from the total outflov; of money from the federal government 
to the revenues of the individual researcher. 

In order to get at the -major problems of financial flows in the 
R&D system, it will be necessary to look more clo-sely at the juncture 
between financial inputs and activity outputs, whicli we sh.il.l call 
the ^'activity unit," The activity unit is any agent (i.e. organi?',a- 
tion of persons engaged in any phase of R&D activity down to the 
individual researcher, as defined earlier) involv<}d in the R&D process. 
Viewed from the point of view of "the activity unit, the funding cycle 
for R&D activities inight be schematized as follows: 
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Figure 21 • Illustration of principle >of financial 
input giving rise to financial flow 
and related activity output. 
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The choice ot inputs and out[vit:s io inLcndcd to poinl: out sevcrai important 
facts about the funding and c^bi-in^, ot" R(5.D activit:ics: (I) Only a few 
organiza tioni:. invoivjd in it are exclusively dedicated to carrying out R&D; 
funding: far R6.D ordinariiy constitutes only one source of revenue, not 
necessarily an irr.portant one, (2) Even in organisations dedicated to 
carrying out an R&D function, there are numerous expenditures which are not 
directly related to an R&D activity; in multi-purpose organisations such as 
universities, expenditure on non-R&D activities is frequently much greater 
than the direct expenditures, (3) A significcmt factor in many R&D activi- 
ties is the existence of an organi/-.:al:iori.*il base, the result of previous 
expenditures. 

Those tacts become of :srcat sii;nif leaner; when it is understood that the 
typical rundim; picture of many R&D activity units involves several funding 
sources, each v.ith different objectives. The way in which funding; decision 
of different M-cncies interact is very poorly charted but is obviously not t' 
be overlookr.cU As an example, one might think of a typical state university, 
deriving most of its revenues from the state government; the state funds are 
understated to he underwriting a portion of faculty research, considered to 
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be a basic part of the teaching process. The university might be receiving 
a special grant to improve teacher training programs, as a consequence of 
which the faculty of the education-related teaching departments have be^n 
considerably expanded. In a given year these same departments receive special 
grants totalling, say, $100,000. If the individual grants are relatively small, 
say in the $10,000-20,000 range, an accurate costing of expenditure on R&D 
activities might reveal that the total outlay is more than $200,000, with the 
cost of faculty salaries being greater than the grant money received. The 
following year the agency giving the grant for the teacher education programs 
may decide not to renew the grant, representing a revenue loss for the uriiver- 
sity of, say, $200,000. At the same time, the RiSdD granting agency might decide 
to double its grants, from $100,000 to $200,000; the assumption might be that 
this would double the amount of R&D work doneo In fact, the university would 
be receiving $100,000 less from these two grant sources. Given the complexi- 
ties of institutional accounting, it would be rash to accept the assumption 
of a doubling of R&D activities, at least under normal circumstances. The 
purpose of the example is not, however, to illustrate how a university can 
arrange to keep a stable faculty in a time of shrinking revenues; it is to 
point out the fact that R&D granting agencies frequently pursue policies 
which, at best, are made with incomplete knowledge of other factors and, at 
worst, are rendered ineffectual by other factors. The example further 
illustrates the role played by the existing organizational base: A significant 
decline in the amounts of money available for faculty salaries combined with 
a constant or rising teaching load would have a long-term effect on the output 
to be expected from a given R&D financial input. 
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This flow model oi Lho fiiiancLal system for MD can be a uiioful looi 
in conceptuali.'-ing an 'expanded* national RcSD system. The following points 
can be made: 

(1) Inspection of the example given above has demonstrated clearly the 
interaction effect between different sources of revenue rcacriing 
an R&D activity unit. It noints out the fallacy of considering 
funds specifically marked for educational R&D as the sole coraponent 
of the system of resources supporting educational R&D. An expanded 
model should, if possible, account for other financial re:.ourccs 
whose use is significant in the R&D effort. 

(2) The model of an activity unit was illustrated by the example of an 
R&D 'producer', a research organization. The model is even more 
useful when attempting to come to grips with the problems of the 
R&D 'consumer*. The costs of R&D 'product c'^nsumption' have seldom 
been considered in financial planning; they are obviously a major 
component of the R&D system, though relatively unkno^^mo 

(3) There is no ii.iplication that the R&D activity unit is necessarily 
institutionally separate from the funding source or the consumer 
of the R&D outputs. If a school system invests in its own 
research and c^-velopment activities, it can be simultaneously funder^ 
producer and conwiior. The same obviously applies to businesses 

that systematJ .' .illy develop training programs for their own employees., 
Such 'internally consumed' R&D is part of the R&D system, and the 
financial flows associated with it are important to understand. 
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The concept of a financial flow does not stand in isolation from other 
aspects of the systemu The activity unit above has been visualized merely 
in the abstract as a "black box"; in practice, we are dealing with different 
levels of complex societal organization with widely varying degrees of 
internal functional specialization. The relationship between the financial 
inputs and outputs is not fixed but dynamic in any given organization; and 
no two activity units are likely to havG precisely similar patterns of 
behavioro It is possible to systematize and study organizational behavior 
from many points of view. In the ^ase of the financial flow, the specific 
behavior of importance is what one could call an "allocation process" and this 
process should be considered part of the R&D system. In terms of the 
categorizations suggeste.d in the section on terminology^ the allocation process 
is in the. category of regulators and can best be undeistood in relation to 
other regulators, which will be described below. For the present it suffices 
to point out that the agent, or activity unit, involved can be considered to 
be at the juncture of two separate flows, as illustrated by the figure below: 



Insert Figure 23 about here 



3. Equipment 

The concept of * equipment' in the sense of material goods used for 
research and development activities, hardly needs elaborationo In fact, for 
many types of research and development in education, it can frequently be taken 
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for granted. Except in setting up new institutions or organizations, one 
can ordinarily count on the availability of buildings and laboratory equip- 
ment; where they do not exist they can be acquired easily. The enormous 
capacity of the installed technical infrastructure of the United States 
renders many types of equipment nearly interchangeable with money as a f ac r 
of production or consumption. (This is always relative. To convince 
oneself of the truth of the assertion, it suffices to compnre the situation 
of the United States with the opposite extreme of certain developing countries 
which lack the productive infrastructure to produce the materials to build 
buildings and where project planning for research requires one to foresee 
things like ordering filing cabinets from abroad months in advance of their 
usage) • 

There is little analytical interest in dwelling upon many types of 
equipment. Almost all the exceptions to this rule are in the field of new 
communications media: language laboratory installations in schools, 
television broadcasting; stations for distribution of educational television 
programs, computing equipment and associated soft\>/are. It is possible to 
trace a flow of equipment of this sort, just as it is for durable items of 
the national infrastructure like buildings: creation and acquisition, installa- 
tion, maintenance, obsolescence and eventuri) removal fiom use. The flow, 
so defined, provides little insight into the processes of educational 
R&D in the United States. At most, one arrives at the concept of, perhaps, 
inventorying critical items where scarcity pcrsistSu 
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D. Regulator system 

Merely defining the concept of 'regulators' is sufficient to broaden 
the concept of the national educational R&D systenio In the conceptual 
framework proposed earlier, they were defined as •'procedural conventions 
determining the activity of agents." Taking this definition as it stands, 
one can interpret it at the extreme to refer to the whole domain studied by 
the behavioral sciences, anything affecting human behavior either in the 
individual or collective sense. This is, in fact, one of the purposes of 
phrasing the concept so broadly, in order to show how the results of a whole 
range of research can eventually have a bearing upon the concept of a national 
R&D system. But once the point has been made, we must attempt to bring the 
concept back down to earth, so to speaks The term 'regulator' was chosen 
with the intent of conveying the prime criterion for selecting regulators for 
inclusion in the concept of the national R&D system: out of the whole possible 
range of individual and organizational behavioral systems and variables, one 
wishes to focus attention on those which have a regulatory function vis-a-vis 
of the other components included in the expanded system, such as the resource 
supply system or the knowledge creation and utilization system. The analyst 
of any component of either system will have as a major concern the definition 
of regulators affecting the object of his study; the possible variety is 
infinite, and only experience will show which are the most significant in 
what context. Since it is impossible to draw up an exhaustive list of 
regulators or, presui ^ly, even to conceive an exhaustive taxonomy for their 
classification, I intend to discuss a few of the more significant aspects of 
regulators or regulator systems which should be kept in mind, and then to 
propose a^ number of types of regulator which appear to be of major significance 
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in inoniLorin^ -/elopmcnts in the national KM) system on a national i)asis. 

In ^ener.jL tornit;, whejnevcr one di^jcu-ses regulators or regulator systems, 
one may consin-r tlumi from two per^jpec tives ; the regulator may be thu product 
of a proces:. by wiiicli thu regulator is created and maintained, or it may be 
an input variabJe affecting some other system element, an input t a process. 
A concrete example of these aspects might be the allocation of resources to 
activities within a research laboratory: one might consider the way in which 
the decision-making process came into being (selection of participants, 
definition of their roles, origin of the rules of decision-making, cnvirontncntal 
factors affecting the origin of the decision-making process and its operation, 
and so forth); or, accepting as a given the factors present at the time of 
any one decision or set of decisions, one can see how the decision-making 
structure operates to regulate the usage of resourceSo In the first instance, 
the I'^sul^tor is viewed as the output of a process; In the second, the 
regulator is an input. Both processes are obviously interrelated and 
may eventually be studied as an integrated whole." 

In summary, then, regulators will be of interest which are significant 
inputs controlling portions of t^vo proce.:ses: the provision and usage of 
resources for research and development, and the creation and utilization of 
knowledge in the R&D process proper. Tlie regulators themselves are the 
outputs of processes which are a legitimate object of concern and study 



^•'This double perspective is useful in tliat it permits one to eliminate the 
artificial dichotomy of descriptive and prescriptive models: Prescriptive 
models arc, essentially, constructs employed to guide bchnvior, that is t .) 
r.rnl.^r jnrlividnn! .vntip '-onduct.: Hrscriptivr mod-V^ .-^r- i di.rforcnl- type 
of'huhavioral guide. Their impact on behavior, whetiier direct or mediated, 
is similarly dependent upon circumstances. 
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inasmuch as they are ultimately inputs to the R&D process: essentially, 
the agents (organizations or individuals) participating in the elaboration of 
regulators, the structures or processes by which regulators come into being, 
the value systems intervening (rules of individual or organizational conduct), 
power relationships, the general environment within which the whole operates 
(social and historical context). Under most circumstances it will be 
sufficient to describe the regulator and its functional characteristics 
without entering into consideration (except for scientific purposes) of its 
origins. A law governing expenditures by school districts, for example, is 
an explicit set of behavioral rules whose operation in a given context can 
probably be predicted within certain limits; it is seldom necessary to 
return to the legislative process by which the law was created in order to 
arrive at the prediction of its impact upon, say, the possibility of increased 
spending for language laboratories. : example illustrates the criterion 
mentioned earlier that our definition of system boundary will depend upon our 
estimate of the degree to which the regul^jtor's operation constitutes a 
regulatory function vis-a-vis of the R&D process. 

The remarks above suggest the dimensions of eventual studies of 
regulators^ I propose below a number of regulators or regulatory systems 
which are of sufficient interest, in my opinion, to be included in their own 
right as components in the national R&D system. They vary considerably as 
regards the degree to which they have been formalized; all are chosen for 
their relationship to the making of policy at the national level and its 
implementation. In each case it should be clearly understood that I am 
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(1.) St ' I r-y i '!-.* .ii Uu' sL ai.i' or Icdcral. Icvrl alTectinj-^ Lhc "ond':.-* 
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(2) 'Yhi- . ! s i nn-:.»ai: i n^: I rue i.M and j> rocr .s r.( fudcral ngcncic:. 
.sp')i: •■>i"!.r4; r kuai [np.al. IvbVO, parLlciiJ arly i.hc National Lnsl ILuI-.l; 
oi iviij v aL ic)n 

( ) Mana^-.Miu'nl: Lochn Lo.uc s for conceived in Llic broadest sense, 

s; .-- : r ally rJiose appLieri: 
(3.1) . . M j^rr Landing sources of R&I) activities 
( -!'V major i ;is t.i tut ions carrying out R&D project work under 

■..'X to rnal I'und i;.^; 
andi, us special cases, two inputs to the process of elaborating 
nanaet^Tien t Lochn ic;ue s : 
('^.,'0 -i-roi^osed models oi the Rtkl) process including specialized 

t ay^'nonie:^ of act iviti.es and roles assigned to individuals or 
* )r[;an i /,aL I<^ns 

( U-^) - -1 Lt .-rnat i VL' models of educational '^futures'', i.e. conceptions 
'<\ what ..-ducation "inight or should be like" (utopian) or what 
it: "is li'-ei.y to be" (j)redictive ) 
(4) 'Iho ad:-:i;. i si.raL Lve systems and policies of state and local ccluca- 
* tio: agencies "'Ltn specific attention to: 

-L' ■ ;,rncess of planning for change in the agency itself, including 

t '10 de f in 1 1 i or< o i' nev; goal s 
-t.:.i.- adoj^t io:! and iir^p Lementation of RikD products (ideas? techniques, 
;::ater Lai i-roducts ) 
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-participation in the generation of i.i5<D products at any phase of 
the process: setting goals, defining means, implementing the 
chosen means, evaluating the outcomes 

-the caLogories of participants eith;;r formally or informally 
associated with these processes 'administrators, teachers, 
studenV.s, parents community/ special minority^ etc, ) 

(5) The practices of major professional groups (teacher organizations, 
educational administrators, professional researchers) including 
the value systems and socialization processes underlying the 
maintenance and evolution of the practices 

(6) The "markcL*' for educational R&D conceived as a supply-demand 
mechanism for process regulation, 

Tt should go with out saying that the above list can be (1) extended to 
include other regulators^ (2 ) subdivided to give attention to particularly 
important regulatorS| or (3) incorporated into one or more taxonomies of a 
more general nature. As far as possible, the list is composed of specifics 

regulators which have an intuitively tangible content. There are three 

exceptions in the nature of special cases, item 3,3 (R&D models), 3,4 
(alternative futures) and 6 (market). The inclusion of models of R&D and 
alternative educational futures under the heading of "input to the process. of 
elaborating management techniques" is defensible only as boing one of the more 
important reasons for theorizing about R&D, not as the sole purpose to which such 
models can put. Whether they are grouped in this way or nor, * nch models 
md ♦ '• •'i^'O -nn }■ 1 i ng n*" ^ 1 L i f"-. h nvo :\ speed nl pl<ico ii; l.lu scb^'r^i^ i*^ i 
nations! R&D system, in that they are both products of its development and 
guides to the future orientations which it will take. As mentioned above, 
many of these mode^ . define taxonomies of procesees, functions and goals which 
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efficiency ot lIiu I^M) proc-oss. 

RefercMu. to a "market" for R&D under tho caCogory of regulators is 
based on a .i.LLar observation of one characteristics of the "market," as 
a regulatory :n.chanism mediating between supply and demand factors. 
Because of the complexity of the concepts involved, it will be discussed 
separately in the next section of this paper. 
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S ection 3. A Reporting Framework for hbnitoring 
the Educational R&D System 

A, WHY A FRAMEWORK? 

The previous section has led us to explore in an intuitive fashion 
the many facets of activity which might be conoidered relevant to the 
definition of an educational R&D system. One need only think briefly 
about the whole to feel awed by its complexity. Ihat complexity is incre. .. .a, 
not decreased, by the irultitude of different techniques which exist for the 
study and analysis of its different parts - A school may well be a r ode in 
a communication network, the object of a decision i expenditure, a 
sociological milieu having defined characteristics, a place v;here a certain 
curriculum is t=^t.ight or an envircnment in which children learn things . 
(These last two are not, of course, synonymous). Academic experts specialized 
in information systems, economics, sociology, curriculum design or child 
psychology will see the school in ever^^ different ways, though all probably 
share some of the oommon attitudes which are supposed to characterize the 
scientific community. Differences in discipline or specialization fragment 
the scientific commiiinity just as differences in personality, social station 
and role tend to diversify the viewpoint of the public at large. On a 
grander scale what is true of the school is true of the vast entity we have 
called a national educational R&D system. 

This diversity is at the heart of the problem of creating a monitoring 
system that is capable of carrying out the objectives specified in the 
introduction. On the one hand, information on the national educational R&D 
system is available in numerous forms, having been gathered by persons with 
very different purposes and techniques. On the other, the data must be 
conveyed to a variety of users. The. rationale used to reconcile the contra- 
diction is based on an approach that might be likened to Russian dolls. 
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A bixDdd frameworlc'' is [■•mTOsed, thfj outline of v.'hi(:ti is n'.lr-i t ivf'lv r.i.ninlo 
to grasp. When its individual components are opened up, thev rire consistent Lx^l 
with the over-all outline and with the discipline bases required for iriDnitoring 
and research on the K&D system. 

The limitations of the approach arc not nepligeable . First, the 
{generality of the framework is such that, in order to come to prips with 
many concrete monitoring problems, it will be necessary to introduce more 
specificity. Secondly, one can postulate safely that there is no way of 
providing all relevant informtion in a fashion that is understandable for 
even a major fraction of the persons who legitin^tely have right of access 
to that information. We are not likely to reconcile completely the 
information requirements of the laboratory researcher, the educational 
administrator and the concerned parent. The best success that can be hoped 
for is to structure a major oart of the information in a fashion understandaible 
by a major portion of the potential audience. In this v/ay interested persons 
can delve into the information base to the depth required for their personal 
conceniS and eventually en^ap,e in meaningful dialogue as partici]:>ants in 
the process of democratic decision-making on science policy. 

B. THE BROAD OUTLINE 

1. Organizing principles 

The reporting framework is based upon a few simple principles 
of organization, soire so simple that they will frequently not have to be 
stated. For the purposes of clarity, the major assumptions underlying the . 
framework are summarized here : 

a. System definition . The definition of the areas covered 
by the framework depends upon the concept of educational 
"sector*', that is, upon the sp>ecifi cation of a set of 
users of R&D outputs > In Section 2, we have defined three 
broad educational Rectors: public, task-orl<^nt^d and infornv?.: . 

" The term "framework" has been used instead of "model" in order to emphasize 
the intent of making the frairework broad enough to accommodate alternative 
"models" of the rI3 process. 
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Though there are other ways of dividing up the educational 
spectrum, these three sectors are useful as exanpl^;^. 
Beginning with one of them as the target population for 
utilization of R&D outputs, it is possible to analyze and 
identify the components of the system of R&D which is 
relevant. Subject to some overlap, the three sectors yield 
three different definitions of an educational R&D system; 
the R&D systems serving the three, v^en combined, constitute 
the total national educational R&D system. 
Beginning with other definitions .of educational sectors, 
either broader or narrower, yields different definitions of 
the R&D system to which the reporting ^framework is 
applicable. The principle remains the same: when using the 
reporting framework to describe an educational R&D system, 
it is^^necessary to specify the sector to vAiich it is 
applicable. (Failure to proceed in this manner results in the 
definition of more limited sub-systems; for example, one could > 
begin by identifying a body of researchers and then determining 
whom they serve, a procedure which would logically lead to 
leaving out of the system definition other potential, but 
neglected, users of R&D outputs). 

• Distinction between producer, process and product . In describing 
a factory v*iich transfonns raw materials into finished products , 
It is possible to distinguish between the tangible elements 
constituting the factors of production (buildings, machines, 
employees), the activities which are engaged in by these factors 
of production and, finally, the raw material in various stages 
of refinement ard transformation. The distinctions are harder 
to draw in the field of R&D, owing to the fact xhat the prxDduct 
escapes most attempts at definition. 
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The distinctions are sufficiently understood that they 
have been used in organizing the elements of the reporting 
f r ajnnework . 

c. Inclusion of resource flows . It is, of course, quite possible 
to discuss an R&D system solely in terms of the persons , 

. institutions and facilities actively engaged in either the 
process of creation or us^ of R&D products. In a frainework 
useful for policy-making purposes , it is essential to 
include not only the actual productive capacity but also tbe 
resource flows which make the activity possible. 

d. Separatingrout reP^.ulators - Purely practical considerations 
have led to regulators bein^ included in the framework 

as a separate elerrent. The intricate network of written 
and \anwritten rules which govern behavior of individuals 
and institutions is largely -.uncharted , and the methods used 
for studying this network are. very diverse. Frequent 
reconceptualizations of mjor [XDrtions of this system of 
regulators are to be expected. Clarity dictated a sort of 
'^nrxiular" approach as a means oi isolating a very obscure 
and confused area from the otJier major elements of the 
framework . / 

2. Eleirents of the framework 

The relationship between the elements of the reporting 
fraiiBWork is shown in Figure 25^ The symbols used in the figure are quite 



Insert Figure 25 about here 
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Figure 2). A reporting model for educational K^d 
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arbitrary; they have been used simply to give a distinctive shape to each 
major subsection of the framewcrk. Ihe coinponents are as follows : 

a. R&D Activities . TTie labels on the boxes are intended 
to cover the broad range of different irodei^^ which have 
been associated with the 'Tciowledge-into-practice" 
concept of R&D. As far as possible, the terms are kept 
"neutral". "Creation and production" of knowledge is 
not necessarily synonynous with the tern "research", 
particularly in the narrow acceptation used by workers 
within the scientific coimiunity. "Distribution and 
exchange" can as easily characterize the concept of a 
coirmunication network as it can the dissemination 
activities of a regional laboratory or a textbook 
publishing firm. "Utilization" may inply assimilating 
a new idea, installing a new language laboratory, or 
maintaining a planning and research department in a 
school board. The terms can be accepted at their face 
value as synonymous with most existing conceptualizations 
of the R&D process, whether this is conceived as 
"scientific knowledge into practice", problem solving, 
human interaction to innovate or what have you. 
Problems arise only vdien one is asked to speci:^ which 
one of these conceptions is meant. All (and others) are 
intended. Further, in brackets next to the boxes, a 
different set of terms is associated with this continuum, 
corresponding to the terms used in dealing with the R&D 
process in the framework of economic analysis. These 
terms c^nd their import will be discussed in detail 
further on. 

b. Infrastructure . The R&D infrastructure is, broadly 
speaking, all those durable elements which make it possible 
to carry out the activities included in the creation/ 
production/distribution/exchange-utilization continuum. 
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'ihe rrajor elements included in the F&D infrastructure are 

i. skilled personnel 

ii . equipment (facilities , plant) 

iii. institutions (or orgaiiizational strucTures) 

Because many institutions and individual persons in the 
infrastructure carry out functions spanning the whole 
range of activities from creation to utilization, the 
Infrastructure is portrayed in Figure 25 as a unitary 
whole, not necessarily divided alonr. *'-ie functional lines 
of R&D activities. 

It is inportant that this infrast-ructure be viewed as 
sorrething broader than the sole creation/production 
function. There are many promising R&D products which 
have failed to be used for want of an infrastructure of 
utilization. For examples of this one need look no 
farther than Run Coirputer Run! (Oettinger 1969); this 
penetrating book is an almost caricatural portrayal of 
the inadequacies of current educational structures to 
cope with the fabled products of "educational technology" 

Resources . The concept of resources is relatively 
straightforward. It comprises the furnishing of money, 
skilled personnel and material gpods necessary for the 
R&D enterprise. Associated with this one can identify 
a second infrastructure of personnel, institutions and 
equipiTHnt necessary to provide the resources. 

Regulators . Regulators have been defined as "procedural 
conventions, determining the activities of a^/jn's." Out 
of the multitude of factors affecting the behavior of 
persons and institutions, one ordinarily will select 
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only a relatively small number to include within the 
framework at any one time. For initial explanation, 
the term can be considered synonymous with the process 
of political and administrative decision-making 
affecting R&D activities. 

It appears to the author that a framework structiired on these lines 
will be sufficient for explanatory and reporting purposes . In general 
public communication, the model can be used' either with the infrastructure 
shown separately, or without it. Little or no explanation is required for 
any term other than "private and public regulators"; as stated above, 
these can be considered equivalent to the public control mechanisms 
exercised through the political process. At a later stage, one can make 
the generalization to include other types of regulator; in practice, for 
most reporting purposes, it may not be necessary to introduce the generaliza- 
tion at all. It is primarily useful for structuring rather specialized 
types of data and theories derived from research studies , such as the role 
played by diverse factors in the process of adoption of innovations . 

With rep-ard to the central concept of R&D activities, the 
neutrality of the terms used is intended to make it understandable by almost 
any public , independently of prior conceptions of how research is done , 
how ideas spread or how education changes. It can be illustrated easily 
by mapping into it the most commonly used divisions of ^&D — research, 
development, dissemination, evaluation, adoption, implementation — in the 
most common context, the public school system. An example may prove useful 
in explanations intended for those not familiar with the field at all. 
The example might center around an innovative product developed by a 
regional R&D laboratory under a federal contract, distributed ttrrough a 
regular educational publisher, purchased by a local school board and used 
in its secondary schools. There is, in this simple illustration, little 
difficulty in classifying the two "ends" of the process: the role of the 
regional laboratory, primarily research and prototype development, is 
clearly to be classified as "creation and production"; similarly. 
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thfi utilization by the school fits in box 3, "utilization" (cf. Figure 25 
for numbering of boxes). Depending upon how one decides to cut up the 
pie, the decision of the school board to adODt the product can be part 
of the "distribution and exchange" process, box 2, or part of 
"utili2ation"; on the other hand, in-service training of teachers to 
use the innovation would appear best to fit under the categpry "utilization". 
The publishing firrr. would have a priirary place in the box for distribution 
and exchange. Evaluation, as a process, can fit in just about anywhere, 
depending on who does it and for what purpose. 

At the level of the "self-evident," the diagram includes, in 
brackets, the terms that would ordinarily be used to describe the P&D 
process viewed as an aspect of economic life. It may be useful to soft- 
pedal economic analogies for publics quite unaccustomed to associating 
educational R&D (or education) with any frajnework of reference borrowed 
from economics . On the other hand , there are numerous uses to which the 
economic frarework can be put, uses which will be discussed further below. 

The use of simple illustrations should be engaged in with 
considerable caution, as their clarity for the layman is frequently 
bought at the price of confusion for persons initiated in one or another 
of the discipline fraireworks which are used to stu-.iy the R&D system. 
The example above can easily raise nuimrous difficulties , particularly 
near the center of the process, the transition from creatd.on to utilization, 
tiirougn the "distribution and exchange" portion of the mode] . Persons 
familiar with real life situations would be troubled by numerous questions: 
How did the school board officials hear of the product and how did the 
publisher seek to reach them? l^Jhat was the prc^cess of decision-making, 
under whose leadership, in what phases? Was this an isolated product sale, 
or did institutionalized procedures exist in the school board by which 
curriculuiT; innovations can be brou^yit abDut on a regular basis? Ihe answers 
to the.^e questions raise problems of boundary definition, which would oe 
coirrxjindec! if t}v." P-p,ional laboratory in the example were one of those 
which tcx^K rx^six)nr.ibility for dinsctly disseminatinp, ^vici "insta i Ving" its 
products in scnools , tliereby intervening in the uti lination process. 
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The difficulties can all be traced to the fact that the example assumed 
specialization of functions between different organizations. This can be 
resolved by introducing the concept of infrastructure: the institutions in 
the exajT?)le form part of the infrastructure, which is not differentiated by 
function (though, for many purposes, institutions will be classified in terms 
of their primary functions ) ; the activities carried out by the infrastructiSe 
of institutions can easily be classified on the creation - utilization 
continuum using v^atever definitions appear most app?opriate. 

Out of the framework elements described here, two require further 
examination, the concept of infrastructure and the content of the creation- 
utilization continuum, particularly with respect to the implications of 
viewing it from an econcmiic perspective, 

C. A MODEL OF THE R&D INFRASTRUCTURE 

The reporting framework sketched above will acooimodate various 
different models of what is constituted by an R&D infrastructure. This 
section is intended to e^lain in greater detail the author's conception of 
how the R&D infrastructure might be conceived within such a framework. For 
practical reasons, the model is explained in terms of an appreciation of what 
are likely to be the monitoring needs of the NIE in the near future. 

1. General concept of infrastructure 

The nodel of the infrastructure proposed here is based upon the 
premise that it is possible to distinguish between the R&d infrastructure, the 
operation of the infrastructure and the regulator system which conditions 
both the creation and the maintenance of the infrastructure and its operation. 
The term "infrastructure" is a generic word referring to "a substructure or 
underlying foundation" (Webster"s New World Dictionary of the American 
Language) which is frequently employed in the sense of physical installations 
such as roads, schools, power plants, transportation and communications 
facilities and so forth. For the purposes of discussion of educational 
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r>^searcij and (lev* -lopiyient. > it is quite c.lr»ar that physical installations alonr/ 
do not d' ' t '-"^mino v-nat one niignt call tlif? "installed cripacity" for hKl), In 
order to Ui uo:v:rul the term must bo defined rrore broadly to includf-' i tut iomxi 

frameworks v;ith the implication that these include a certain capacity 

for work orc^.anizanion and skilled personnel, as well as physical facilities. 

The purpose of this note is to explicate how this broader concept of an 
infrastructure can ue conceived within the framework of a system of regulators 
which control its operation. 

2 . Components of the model 

ripure 26 illust*rates the interrelationships of the major elements 
in the rrodel of tne K&D infrastructure. The dotted lines enclose the elements 
of the infrastructure proper, separating them from the major elements of the 
regulator system affecting their operation. 



Ir.sert Figure 26 about here 



a. Tne Primary Infrastructure 

'ihe "primary infrastructure", designated as ^C^ on the diapram, 
is the basic grouping, of elements involved in carrying out R&D functions in 
a direct fashion. Skilled personnel and equipment facilities are pictured 
as being included within the institutional framev;ork. 

To nonitor thie primry infra5t"ructurc at a given time, one 
counts tne number of ir:stitutions , persons ajid facilities and categorizes 
them, ihis is tne equivalent of a census and cross -taI)ulation of the results. 
Tne usual cross-tabuLation v;ould be by element description and function. 
The description v.ouid ordinarily be, for institution^; , their legal status 
(publicly supported universities, privately owned businesses, etc.): for 
persons, their qualification level r-^nd t^/pe (FT^.D. cognitive psychology, etc.): 
for facilities, their most obvious usage characteristics (buildings, laboratory 
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equipment, TV studios, etc.). The function classification is ordinarily 
based upon soire taxonomy built around the type of work done, such as 
"research", "developirent", "dissemination", (with probably finer categories 
where relevant), objective sought (curriculum reform, equalizing 
educational opportunity) or ediacational public served (secondary school, 
elementary school science, preschool etc.). 

b. Resource inputs 

A census of the primary infrastructure will provide a description 
of its elenBnts at a given point in time. 'If one seeks to understand its 
evolution, it can be done analytically on the basis of the factors which 
constitute "inputs" and whose relative scarcity determine its growth. 
The prine scarcity factor is, of course, money. In ai economic sense, money 
permits the "purchase" or "rental" of equipment and human services as factors 
of production. Ihis is shown in section B of the diagram. The dotted lines 
from noney to "skilled personnel" and "new facilities and equipment" 
indicate that there is a substitution involved between the financial and 
physical flows. (Raw naterials also are inputs to the productive process 
but are not considered here, as they are considered expendable stocks rath-^r 
than semi-duralu*' components of the productive process). 

Monitor ing involves determining how many ''units" of a flow 
occur during a time period: dollars granted per year, students graduatinj?, 
per year, pieces of equipment installed, etc. In practice, the onlv flow 
usually nonitored , as such, is financial. Personnel end equipment are 
monitored on a census basis as part of the priirory infrastructure and on an 
output basis upon exit from the secondary infrastructure. The reason for 
this is that the secondary infrastructure feeds into other sectors besides 
the one involved here; not all students receiving specialized training in 
educational research go to work in educational research and all the recruits 
into educational researeh do not come from the secondary training infrastructure 
directly. 
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In addition to the inflov; of resources to the primary infrastructure, 
there are obviously outflows associated with each factor: nnoney circulates, 
people move to new jobs and retire, equipment is worn out or retired from 
use because of obsolesence. Ordinarily these outflows are not monitored* 

and. are not usually of policy interest unless they attain "unusual" 

proportions: brain drain to other sectors of activity, equipnBnt used 
extensively for non-productive purposes, etc. 

This simple model of resource flows can be expanded and rendered 
much more detailed. Some examples of the way in which this can be done 
are given in Section 2 of this paper. In particular, the exainple of a 
skilled manpower supply system can be made exactly con,f^uent with this 
model; the same applies to the schema of financial flows for individual 
institutions or research units. 

c. Secondary infrastructure 

Ihe input flows of pf?rsonnel and equiprrent are themselves the products 
of a secondary infrastructure, shown in A of the diagram. The com.position 
of this secondary infrastructure is exactly analcpous to that of the priiiBry 
infrastructure, as is also the process of resource inputs to the secondary 
infrastructure. The input-output characteristics of such infrastructure 
relations constitute a recursive loop which can include, theoretically, all 
productive elements in society. 

vr Financial inflows are ordinarily equal to outflows over time, subject to 
minor adjustments for operating capital reserves. The only major problem 
posed is how one accounts for large capital expend it ii3?es on equipment which 
is used for research ani then, after a time, converted to "normal" usa. 
Ihis mipht be the case if a special school v/ere built for experinK^ntal purpose 
then conven.-od to re.frul.ar teaching. The "Frascati. manua]." (OECD 1970, nara.ll 
proposes that such disinvestment be recorded separat.ely in estirrwtinp 
'expenditures. 
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The level of detail shown in the diagram is lesser for the secondary system, 
reflecting its diminishing importance for monitoring and policy-making 
which are ained for the most part at the primary infrastructure. 

The nonitoring of the status of such an infrastructure can be carried 
out in the sane way as for the prinary infrastructure. In practice, policy 
on educational R&D is not frequently concerned with the equipment "flow" 
or the associated productive infrastructure, except where the equipment is 
of a particularly specialized nature (media installations such as broadcast 
and prxDduction facilities for educational television) or is itself the 
object of an R&D effort, such as would be the case for the manufacturing 
capacity associated with producing equipnent for use in computer-assisted 
instruction. For this reason, monitoring would be confined mainly to 
personnel training infrastructure. 

d. The Regulator System 

The regulator system shown in the diagram is intended to show the 
nechanism which governs the flow of financial resources as inputs to the 
prinary and secondary infrastructure. It does not include a great variety of 
other regulators vihich affect the operation and interrelationship of the 
elenents of tne infrastructure. These might include, for example, the 
determinants of personal decision-n«king for individuals who might be potential 
recruits into the skilled mnpower training system or the numerous factors 
determining the allocation of production facilities within the equipment 
facilities production infrastructure. 

Ihe priire control nechanism is viewed as being the production outputs 
of the R&D prinBry infrastructure (though, in practice, the intermediate 
outputs of. the secondary infrastructure are also considered in analogous 
fashion) . Depending upon whether these outputs are from publicly-supported 
agencies or from private enterprises , separate feedback mechanisms are 
involved. The private sector is governed directly by the market mechanism; 
the rate of financial return is the prime clement governing subsequent 
investnent decisions. In addition the private sector is subject to second- 
level regulatory and incentive practices of public agencies-, these repulators 
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are not explicit ?.y shown here. In the public sector, the outputs are 
considered by a process of political decision-making in the light of what may 
be called "public wants". Ihe operation of the regulator in the private sector 
is subject to analysis using the standard ^ools of the private economist; 
the franework for the public sector is similarly general and can be made 
congruent with the usual theories of public finance (cf. Musgrave 1959). 

3. Applying the model: How many infrastructures? 

Defining the boundaries of the R&D infrastructures involves 
establishing certain basic definitions about R&D, These definitions can be 
visualized as two dimensions: breadth and function (cf. Figure 2). 

a. How broad R&D 

Ihe supply-demand/production-utilization nodel for reporting 
suggests strongly the need to monitor the R&D infrastructure. along a whole 
continuum ranging from basic, discipline-oriented research to the final 
consuner base. However, the consuirer base is obviously much larger than the 
piroduction function in terms of the numbers of institutions and persons 
involved, quantities of money expended, complexities of relationships etc. 
For this reason it is necessary to use a different scale of "intensity" for 
TTonitorinp;, gathering progressively less detailed data as the size of the 
system studied increases; this is roughly similar to using logaritJimic-scale 
graph paper for illustrating growth curves where increase follows a pattern 
of geoiretric increase. 'Accepting the principle of broad monitoring does not 
mean that equal levels of detail are involved. 

b. R&D for whom and for what? 

Educational R&D can serve multiple consumer bases. Ihe prime' 
concern of the NIE is with the K-12 system and related conpononts of the 
formal educational sector. It is possible also to nonitor the task-oriented 
sector and the inforiral sector. As with the continuum of creation-utilization , 
this dimension also involves a change in brute size and rorriM.exJ ty: the 
task-oriented sector is larger than the formal sector, and the infomal 
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sector far exceeds ix^th in dimp.nsions. For reasons of both size and like- 
lihood of related policy initiatives, a similarly decreasing scale of 
nonitoring is recommended. 

c. Monitoring the R&D infrastructure 

In principle, one can nonitor any elenent or flow included in the 
model of the R&D infrastructure. The attached table (Table 1) outlines the 
author's personal suggestions for the najor types of nonitoring required 
within the nonitoring system. 

D. AN ECONOMIC PLRSPECTIVE ON EDUCATIONAL R&D 
The "social change" perspective 

The "distribution and exchange" box in the reporting franework 
requires to be examined in more detail. Its graphic representation includes 
as a simple mnemonic device, a dotted line, symbolizing that it is of inde- 
terminate breadth. Depending upon the d -xiunistances , (and the definitions 
used for describing the circumstances), the functions included within it nay 
be exercised either as part of the creation/production function (active 
dissemination by an R&D producer) , by the user as part of a general set of 
organizational problem-solving or innovating behaviors, or by a third party 
(publishing house, information service, ERIC etc.) In nost real -life 
situations one finds a combination of all three sharing the function in a 
multiplicity of patterns. 

There is no method which can be said a priori to be the "right" 
method of viewing this function. The most extensive review and classification 
of the literature (Havelock 1971) distinguishes three major perspectives or 
strategies related to the innovation process: "research and development" or 
theory- into-practice , social interaction and problem solving. It is sy to 
perceive that these categpries divide along the lines of whether the distribution/ 
exchange function is being viewed from the perspective of the creation/ 
production "end" or the utilization "end". The "research and development" or 
theory-into-practice literature derives largely from writings intended to 
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show how to make the creation/production function more effective, partieulnrly 
by extending its scope in the direction of utilization ; this literature has 
led to the current trend of replacing the users "research and development^' by 
a whole string of functic^s: research, developinent , dissemination, demonstration, 
adoption, impleuBntation , etc. By contrast, both the "problem-sol vinp," aiid 
the "social interaction" approaches result from visualizing the process from 
the utilization "end". (Havelock^s proposed synthesis, a "linkage" model, is 
traceable to the superimposition of a communications r jtwork approach upon 
the interactions viewed from the "user" p>erspective) . 

Whereas it is possible in retrospect to see in the literature a clear 
division between the production-oriented "research and develooment" model and 
the "proulem solving" and "social interaction" models, tiii^e is tending to blur 
tiie distinctions: users must te concerned with a reliable flow of information 
and products; producers cannot ignore the desires of the user^. Either is 
futile without the other. At either end of the spectrum, whether near "basic" 
research or day-to-day educational administration and operations, there is 
clecHr differenti.ation of concerns; but from whatever end the production/exchange 
function is viewed, there is a convergence, 

Tnis converp;ing literature (cf , the references cited by the authors 
mentioned earlier, Fiavelock 1970, 1971, Dalin in press, Fullan 1973, Huberman 
197 3) is uivified by its concern with the process of change, defined either 
exDlicitlv or implicitly as intended to result eventually in a change in the 
ij'^ihavior of the participants in the teaching process, TIk^ mifying traits 
which characterize thosn studies might be summarized as follows: 

a) 'ihey are alrrost entirely concerned with t}ie human factors affecting 
chanr.e in the educational system and how to orgajiize or modify these factors 
to orerite irore effectively. Much of the literature, particul^irly during the 
19bO's ana early 1960's, dealt with leadership roles and the process of 
decisj.on-m-Rking, sometimes in the form of proposals i'o tidopt certain procedures 
(PFBS, "systems" approacii, etc), ihe perception that formal decision-making 
structures and the actions of authority figures were often unruvlateci to 
actual teaching practice in the public school system, nas led to progressively 
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nore probing analyses of how inforn«t.ion and resources (new products etc.) 
are transmitted to the user and what conditions make possible their application 
As Fullan (1973) has pointed out, even with probing has failed to recognize 
that the "user" in the teaching-learning situation is not only the teacher 
but also the student and, in an ultimate sense, the society in which both 
live. 

b. One finds in the literature the same sets of assumptions 
identified hy March and Simon (1958 p. 6) as underlying the literature on 
Organization theory. They grouped these underlying assumptions into three 
broad classes , each concerned with what properties of human beings have to 
be taken into account to explain their behavior in organizations: 

•••that organization members, and particularly employees, are 
primarily passive instruments , capable of performing work and 
accepting directions, but not initiating action or exerting 
influence in any significant way. 

...that members bring to their organizations attitudes , values , 
and goals ; that they have to be motivated or induced to partici- 
pate in the system of organization behavior; that there is 
incomplete parallelism between their personal goals and organi- 
zation goals; and that actual or potential goal conflicts make 
power phenomena, attitudes, and morale centrally important in 
the explanation of organizational behavior. 

•..that organization members are decision makers and problem 
solvers , and that perception and thought processes are central 
to the explanation of behavior in organizations. 

These assumptions are recalled here because the assumptions built into the 
framework of analysis used, will determine the type of conclusions one 
draws about the interface between the R&D creation/production function and 
the utilization function. 
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2. Prior proposals for "market rnodels" of R&D in education 

It is interesting to note that the volume of material on 
educational R&D witten from the "social change" perspective is not matched 
by any similar flow of publications reflecting concern for the economics 
of R&D, One my hypothesize that this situation results from the comparatively 
low level of investment in educational R&D. As a proportion of Federal 
R&D expenditure, measured using the definitior.s of the National Science 
Foundation, education rose from 0.1 per cent in 1963 to 0.8 per cent in 
1972 (NSF 1973, p. 26). A parallel hypothesis (admittedly without real eviden 
is that the failure to consider the economic effects of investment in^" 
educational R&D may have been one of the causes for the low level of support 
which it has traditionally received. 

If one leaves aside articles reporting current levels of 
expenditure on educational R&D and commentary on how a given year's federal 
(or given institutional) budget might be divided up; one is hard put to 
find a handful of articles that view educational R&D in an integrated 
fashion as an economic sector. Current funding levels have sufficed to 
bring educational researchers and similar pc^^ons to write on the educational 
R&D sector but have apparently been insuff - i^nt to inspire major economic 
analyses . 

To the author's knowledge, the only possible exceptions to 
this lack of a general economic perspective are pn:)vided by certain 
proposals found in the literature for treating R&D ^iccording to a "marKct" 
rrodel. Perhaps the best known proposal in this vein v;as put forvard by 
Gideonse (1972). The basic statement of the model concept is in the 
following quote: 



137 

o 

ERIC 



96, 



[i]} ional resear ch ar id devolopno it mus t l>e conc e i ved in 

the iTvirket, < x>n siin>'-rs ^ and clicnris it is :;upposed 
to serve. Only aFtiT tfiat princ i ple is firmly "efUahli shed 
sh ould attention be dirvc ted to th e^processes , techniques, 
and functions which mip/it accomplish that service. 
Prerequisite to the application of ncience to education is 
the examination and redefinition of what the education 
market is, what it means to consider clients or practitioners 
as a "market", and how to translate narket requirements (con- 
ceived either in present terms or desired future terms) 
into product or outcome statements that will provide useful 
guidance to the development of research and develojment 
policies and practices, (underlining in original). 



As pointed out by Clark (1972) in an accompanying critique, the mDdel is 
not a model at all, but instead a single coneept. It might be rephrased, 
in my view, as an appeal to use the needs of the potential users of R&D 
products as the basis for designing and developing the products, 
'^ideonse reconmends that attention be given to the distinction between 
producing ppods (or services) and satisfying customers: 



'The key point... is that those industries that have 
inaintained a posture of satisfying customers have 
thrived; those that have concentrated on producing 
goods have either stabilized or gotten into serious 
difficulties . 



In essence, Gideonse has recoirmended a "marSceting" strategy for managing 
research and development, rather than a "market" model. 

Another line of thou^t on the subject has been to consider the 
weakness of the current R&D system in the light of economic behavior in 
the private sector of the econoiry. In the same collection of papers with 
the Gideonse article, Glass and Worthen (1972) go even farther, proposing 
to move "schooling out of the grants economy and under the influence of 
the market mechanism"; once that has happened, they say, educational 
development and diffusion would "flourish". The major part of diffusion 
would also be moved into the private sector, accoixiing to their proposal. 
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Ihe brunt of their argunent is concerned with changing education to fit 
a simplified , partially managed laissez-faire irarket model ; in turn , 
they feel tlus will cause educators to change their behavior patterns. 
It is the converse of the Gideonse model, which respects the wishes of 
the consuner; here the intent is to use the rrarket as a force to wake 
the educator chanp.e to fit their viev of a good R&D consuner. In surr., 
it is a proposal to chanp.e education, not a model of a irarket nechanism 
for R&D, at least not any nechanism that might conceivably exist in the 
near future. 

Bepinning with sim-ilar premises, Pincus (1973) arrives at 
a far rrore realistic set of pro^xDsals, nost of which have direct bearing 
upon educational PAD. His paper compares the public schools, which tie 
describes unflatteringly as "self-perpetuating bureaucracies", with the 
"competitive firm", attempting to pinpoint the differences in behavior 
patterns which result frem the different incentive structiores of such 
organizations, particularly behavior patterns likely to affect the 
adoption of innovations in adminislTation oi' teaching practice. 
Pincus 's approach is thiat of "restructuring incentives" and, although 
he does propose experinents with systeniS such as voucher alternatives 
to the usual obligatory attendance schemes for public -^choc^ls , tW; intent 
is to accept schools as they are (or as Pincus perceives them to be) , 
without simply proposing the abolition of their current structure. In 
other words, from total catastro',;Jiic chanpc of the lyi^e proposed bv Qasr. 
arid Worthen, there is a shift to irarginal rr.^iipulation of incentives, a 
standard marketing technique. At the forral leve] , Fincus is proposing 
to consider the schools in their role as a sort of narketing o-panizat Ion; 
supplying or 'producing' education; the narket l-^eing cons.iderec^. is the 
nwrket for education, not H&D. Underlying the whole papc-r and its 
nun»5TOus insigjitful sug^.estions is, however, a fui-damentally different 
concept, that t;ie school system is also a 'consuner' of innovations an^: 
new i--i-:ao. Sii.o.: .no c;onc'>pL of a nvarket for R£tD-is r.ct enlargGd uix^n 
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at any point, we are probably dealing less with a model than with an 
analogy. Or, to be iiore precise, we have a potentially very useful model 
of the incentive structure of the Dublic school system, viewed as a 
"consumer" • 

3. A proposal for a supply and denand or "market" model of R&D 

Although this brief review of "narket" models of educational 
R&D has shown the incoirpleteness of the models proposed, the author is 
convinced that considerable benefit would derive from pushing this 
analogy further, using it as a basis of research and explanation for certain 
aspects of the operation of the educational R&D system. Ihe utility of 
such a frainework for explanatory purposes appears so obvious that it has 
been included on the proposed reporting framework, wtth the associated 
tenns placed in brackets. The concept of a supply-demand situation is so 
widely understood in our society as an organizing concept for the delivery 
of both goods and services, including public services, that its generaliza- 
tion to the field of educational R&D would provide a conceptual framework 
almost universal in its accessibility. 

As the author is ndt an economist by profession or academic 
credentials , he feels it necessary to sketch here only the general outline 
of what appears to be a useful approach to using the rrHtScet concept of 
supply and demand as a model for certain parts of the educational R&D 
system. All tho renHrks below are therefore preceded by an implicit, 
"to the best of the author's understanding." 

a ) llie basic concept 

In economic writings the term 'market' is used in a variety 
of acceptations, ranging from the narrow physical sense of a meeting place 
for buyers ajui sellers, to the rrathematical theories of how supply and 
demand interrelate, to the very broad concept of "the entire web of 
interrelationships betv;een Duyers, sellers, and products that is involved 
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in exchange" (Steiner 1970, p. 575)- In this sense it is impossible to 
separate the concept of market from a h**^ ' of other considerations. The market 
is an exchange mechanism governed, \i\ princa-^le by "supply" and "demand"; 
associated with each of these is a productic and a "consumption" function. 
Much of economic thought in the past '^^"'o r^iituries has gone into explaining 
how the setting of prices within a market serves to bring supply and demand 
into equilibrium over a period of time by reguliJting the allocation of 
resources within a society (Arrow and Hahn 1971). Ihe simplest textbook 
model shows hov: oversupply leads to lower prices and lower income for producers , 
creating a disincentive to production, and vice-versa; on the demand side 
of the market, clnaj.ges in prices have an analogous effect by encouraging or 
discouraging consumption, the v^iole resulting in a dynamic series of 
adjustTOnts tending to bring production and consumption into equilibrium. 
In essence, this is the basic mechanism which, it is proposed, should be 
considered tl-ie center of a supply and demand ("market") model. IVo reasons 
c^ippear to explain why so little use has been made of this phenomenon in 
analysis of educational R&D. 

The first reason is either that most writers on the topic are 
preoccupied with the content of the educational reform or improvement that 
i^&D may achieve, or they do not associate market phenomena with educational 
institutions. The transactions involved are, however, quite straigjitforward . 
Iri a simple case, the user pays directly for what he receives, as when a 
School board purchases text books. Thiis transaction ultimately pays for 
the developnr^nt which went into the creation of the textbook. Other 
transactions occur between two i=;ubsidized , state-supported institutions with 
no.nonetary flow involved between the two. Ihis is not a change in the 
l:'asic nature of the transaction, simply a different type of flow. In one 
instance, financial inputs from a tax base are used by a schcx:)l board to 
buy the prodact directly; in the other financial resources pass via a 
subsiviizing agency to tiie R&D producer, who furnishes the service "free of 
charre" . 
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The other reason is associated with a basic confusion between 
ttie term "narket" and doctrinal stands on how the nation's economy should 
t>e run. Various political and economic doctrines have been erected on 
the foundation of supply and demand, their crux being in determining the 
effect of allowing the rrarket mechanism to operate "freely"; the 
discussions range from the Marxist tenet of the inpoverishment of the 
proletariat, through the question of whether the rarket mechanism 
results in the optimal allocation of resources, to the issue of whether 
International free trade is beneficial. It is important to realize, 
therefore, that in talking of a "market", one has not automatically 
endorsed any belief structure associated with it, such as the advantages 
of free enterprise and/or laissez-faire > In the context of the United 
States econoiry as it is presently organized, even brave talk of moving 
education "out of the goants econony" could hardly be interpreted as 
laissez-faire , since the U.S. econony is regulated and controlled in a 
great diversity of ways by federal and state governments. The underlying 
justification of such intervention is, in fact, the imperfection of the 
market mechanism as a regulat^^r for economic life. It bears repeating: 
Speaking of a supply-demand model for educational R&D does not mean 
subscribing to an unregulated, price-ccyitrolled market mechanism. 
Having said this, the author nevertheless feels it necessary to point out 
that , particularly in publications intended for a non-expert public , the 
terms "supply and demand model" is probably preferable to "maricet model"; 
the former is less likely to encourage confusion on this point. 

•Using the supply and demand concept to describe educational R&D 
raises numerous theoretical problems. Rather than view these problems as 
obstacles, one should probably treat them as challenges. In all likelihood, 
studying them will shed considerable light on other aspects of R&D viewed 
as a social change mechanism. The following appear particularly noteworthy: 
defining general market structures; studying specific p"*oducts and services; 
distinguisliing between educational products and educational R&D; relating 
the concept of "need" to the concept of "demand", and extending the analysis 
of econoniic benefits to other sectors than public education. 
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'Plir- lir-.Mnl t.h^^or-'t.l fvnl fi I r;Mnt:t.l(>nr. aro based \\p<v : />rj t.nfforl Lion of 
t\v> "f^l-^ ^'f the .'uipplifMv; in a m/^rkot, so that one dl r.Li r^/-OJi shon b*^twr?on 
"p. r»^^•'■. ' 'onipp^^ Mc^n"^ "monopoly", "oliGopoly", "monopol 1 55tic competition" 
and r. I'or.t of r>t.her variants (such as the "grants economy", reforrr?d to by 
ftlnrn nr)6 l-'orth'^r). V/ith regard to educational R 5- D i t ^* n clear that n 
v^.-'lety of '^la.^sj fieationr; would result, dependin^r upon ^l) the nature of 
hho product being oonsidered and (2) the sector being served. The rrr^rket for 
the training needs of O'-ivate busine5i?=: firms differs rrarked.ly fr'Oii that of 
curriculum packages aimed at the public school system. Tlie forrrr^ approxi- 
mates olosely to the situation of freo competition (via a best of rmnll 
corsultinr: f ' rms and individual consultants), whero-cir the latter is sui 
Kcnerir : private firms compete with subsidized producers (R D laboratories, 
etc. ) bnt rorretimes dei^ivo an ind^.root subsidy from them by obtaining 
distribution rirbts to products developed at public e^oense; the products 
are marketed to ar ol 1 gopol.istT n consiimer ba'?e (domjr^at'^d for textbooks 
and many currlcMlar matori:)ls by the Califcrria and Texas markets) that is 
cajol'-'d irto u-iln^ them by a helt>er-skelter array of ino'-^ntlves and information 
systems of dub^'ous efficiency. ^ ^. "ur.\''^r r ubr.i f^'^f''^'' y'\ '-hr^ll wo say?) 

Simple ] aN^llI n;: 'v:ide, the ov<^r-'!ll strnic^ture of r.upply -vni dcm.'md 
for H tK- n prochi'M.s fp:oods ■j»-ti -(m^v i cf-. ) I-, h'-rdly (•h;M**.''fi tlier* by f^'iiicn- 
1 1 f'>nn I s' iM-or et* by ppfKbjf^i . Our l'»ek o!* knowl'^d^:^ ^-^^ 'h-: rnatt'^r '.■ nV')ysm.'il. 
Do we hf^v^ r>ny bnr:ls for fM^edictir-K, for e'':f;mpl'^, the i'-jj-.-icf ifpon "demand" 
(defined as r.cnept-^nce by ^ionsufners) of increasing tela^ f''xieral .';ubsidi e.-: 
to R n produ.'er"^ tv;offO.'i? ^onfold? T*-. there any bs.-'ir- for supposing that 
the i n re a so i r su bs> i r 1 1 e s v;ou Id be ma tched by a nr o por t i o' • a te i n crease i n 
"sur;plv"? Do w«-> bn^t- o>;>of.t; productive capacity, only v»r.iting for an increar.rd 
pon*^tary dem,ar;d? The arr.v^f^rr to these questions, involving the simplest 
(to poroeivf:^) cor.c-r^-r- of elasticity of supply and demand, are oui te beyond 
us today. Tr fact, th'''y are practically unavailable everi for a handful of 
p rod I : ? t f > . 
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c ) Studying specific products and services 

Up to this point, we have been discussin, markets in terms of 
aggregate supply and demand for fMcD products. Ihis simplification to a 
unified market is dependent upon our ability to sum supply and demand for 
large numbers of products; however, as we have said, there is little raw 
information on which to base generalizations. The remarks made earlier 
concerning the structure of the market for textbooks and the dominance of 
two states in that market, for example, corresponds more to hearsay evidence 
than any assessment of real data. Numerous product marketing histories are 
required to begin delineating how educational R&D markets vary. For instance, 
it appears obvious (but may not prove true) that the distribution of consumer 
"clout" is probably far different in the field of marketing language 
laboratories than in the example given above of textbooks. On the other hand, 
it is also clear that the market for teaching aids as a whole is subject to 
quite specific univorspl constraints, resulting fron the fact that budget 
patterns tend to chanee slowlv and most nublic education budgets are used for 
salaries. 

Detailed knowledge of the financial structure of the market for 
individual products may be vital to definition of product development 
strategies and to public policy. For example, if one discovered that some 
area of development were being largely ignored by the private sector and by 
publicly subsidized R&D institutions, such knowledge would make it possible 
to make a more rational allocation of public support funds in the area. At 
one extreme it might turn out that the whole research-development-distribution 
installation mechanism was extraordinarily expensive compared to the potential 
buying power of the intended market, thus ruling out the possibility of basing 
R&D strategies on the private sector aind making it necessary to create a 
subsidized operation from beginning to end. At the other extreme, one might 
find that several private companies had given a try in the field before and 
been "burned" Just slightly, barely recovering their investment; if one could 

track down the specific causes of their problems insufficient product 

research to render at effective, high training costs borne by the marketing 
firm to initiate potential customers to the new product and its usage. 
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tendency of customers to buy the product without beinK able to afford 

maintenance for it, etc. , It might be possible to achieve the desired 

effect t)y a low-cost program aimed at solving the specific problem, not 
replacing the whole existing development and distribution mechanism. 



d) Defining: the F&D content of economic transactions 



This example raises an important issue which has -not been addressed 
so far: The "products" discussed here have generally consisted of two elements. 
The first is the visible good or service proviaed to the educational user. The 
second is the invisible R&D proportion of that product. What proportion of a 
textbook in science, for example is "R&D" and what proportion "routine 
publishing and distribution"? Surely it cannot be that B&D is the portion of 
the work that is subsidized by the National Science Foundation or the federal 
government, as opposed to the portion that is carried out by private enterprise 
without help. This throws us back to the problem of criteria for defining R&D, 
discussed in the previous section. In most cases the distinction can be shown 
symbolically by referring to the concept of "prototype" development and linking 
it to the creation/production function in the model. However, there are numerou 
oases where the R&D product requires what one may call a 'clinical' approach to 
users with follow-up assistance. It is essential that any economic analysis of 
educational R&D take this into account. The fact that a product is acquired 
at a given point in time may eimount to only a portion of the total transaction 
to be considered. T'he other portion of the transaction is made up of the 
services furnished at a later period in time. 

Thus, we are i'aced with two intermingled problems: (l) The total product 
transaction does not necessarily occur with the initial transfer of goods or 
services; there may be follow-on components delayed in their arrival; some of 
these may even be .provided by other sources than the original furnisher of the 
R&D product. Curricular materials might be marketed, in the sense of physical 
products, by a publisher, but the original developers could easily be involved 
in providing support to the users in the form of training workshops under a 
special third-party grant; this was the case of Harvard Project Physics, to 
name but one example, (?) There is the definitional problem related to this 
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transfer for the purpose of defining a market. A market for educational 
products is not synonymous with a market for educational R&D. Whatever criteria 
one may choose to adopt in determining what constitutes R&D, it is necessary 
to make the distinction between routine production and R&D. 

e) The relationship of "demand" to "need" 

The acquisition of educational products in school systems is determined 
by a decision-making procedure which usually involves the intervention of 
school boards and taxpayers in fixing budgets and administrators in spending 
the budgets. The same applies to any redistribution of resources which may be 
involved in carrying out an innovation. These mechanisms and dec is ion- making 
structures account for the structure of effective demand for educational goods 
and services. On the other hand, there is no guarantee whatsoever that 
decisions made by these structures — for example, to introduce a new teaching 
method in connection with a new educational product — will result in any 
change in teacher behavior. Thus, in theory, provided the decision-making 
structure continues to show its interest in acquiring the outputs of educational 
R&D, it does not matter whether this effective demand corresponds to any actual 
application. 

The opinion of those who implement educational changes constitutes what 
one might call a " second- level" demand structure . This demand structure is 
not necessarily expressed by a poll of opinions, as willingness to agree to 
use a new method or device does not in any way guarantee that, no matter how 
sincere the educational practitioner, he will be able to change his own 
behavior effectively to match the expectations of the innovation so introduced. 
This behavioral substrata of demand is a level beyond the usual expression of 
willingness or unwillingness to acquire; it is the cause of numerous failures 
to follow through with innovations. 

In short, anomalies in the structure of deiranri result in well-documented 
difficulties. Demand is not necessarily matched with practitioner willingness - 
nor, given willingness, with practitioner ability to put an innovation into 
practice. This second- level demand structure may well be organized and studied 
in order to bring higher- level decision-i..aking into accord with it. However, 
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in order to be complete, one should also try to go beyond the structure of 
demand to rionside/- the stmcture of "need". Needs may be expressed at the 
individual level of the educn^.ional client, the child in the regular public 
school system, or they may be manifested at the level of the community. Various 
dimensions of these need structures are the meat of many educational research 
studies; seldom have they been associated with an economic analysis of the 

framework of demand. 

There is a great public policy need to begin the theoretical and practical 
task of sorting out the structure of need and demand* It is in sorting out this 
structure that the role of the federal government is most clearly called into 
question. For, by definition, the investment of public funds in any aspect of 
educational R&D is an intervention to create an economic demand. 

£>) AnalvzinR the economic benefits of educational R&D in the task ^orientec 
education sector 

To the author^s knowledge, there is little reliable data in exisT • vhicl 
clearly relates the benefits of improvine task-oriented education to increased woi 
productivity. Such an analysis will probably reveal large sectors where minimal 
public investment will result both in direct benefits to the business employing 
trained. persons and, through diminishing social welfare and other costs, to the 
economy as a whole. It is only in the presence of such data that a rational 
allocation of funds can be made between R&D activities serving different sectors. 

Cumulatively, the areas of potential study using this framework are so 
important that, in the author's view, they cannot be postponed. Their results 
may cast a more practical light upon the prospects of speaking of a "supply. demand 
model" of educational R&D. 
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Section ^, Implications, Recommendations, Suggestions 



While preparing* this paper, the author has had the opportunity for 
extensive discussions with NIE staff members regarding the general, problems of 
developing thr* national liStD system and the specific question of creating a 
specialized monitoring unit at NIK-, iho pages of this paper contain numerous 
methodological suggestions. Thf? following is a summary of the author's 
major recommendations and suggestions that affect policy on monitoring: 

1 . There? is a clear need for the creation of a specialized monitoring unit 
ar. the NIK. (Er. is the author's understanding that a preliminary decision 
has been made to crr-ate one). 

2. Thf monitoring unit should have a broad mandate . It .sliould not be limited 
to doing pol icy-rol atf'd monitoring. The monitoring function should be 
set up in such a way as to serve three major functions: 

a. tixternal communication and public accountability 

b. Internal policy making 

c. Research on the system 

The implications ol these functions are spelled out in the next points. 

3. External communication and public accountability 

The external reports of this unit should not be conceives] a-s a means of 
justifying NIE policy, either past or present. The NIE is more than an 
operating governmental agency; it is an independent guardian of the 
free processes of inquiry and criticism by which educational reform 
should be carried out in a democracy. A monitoring unit within it 
must be given the autonomy to publish the facts as they appear to be, 
on a regular basis and without distortion or suppression. 
^4. Internal pol icy making 

As time goes by, the monitoring unit will acquire a fund of knowledge about 
the operation and structure of the national R&D system which will be invaluable 
for the assessment of policy proposals. This information should be brought 
to bear on a|j major policy issues at the NIE, not only the policy issues 
related to the programs of the Office of Research and Development Resources. 




ERIC 



1 



In particular tho information available should be. brought to bear by 
policy planners on tho crucial pr()f.>loin of assossinr, the cumulative impact 
on the K&D system r)\ .separate, discrete policy ini tiat i vos * that are 
apparently unrelateri lo each other. 
5 • Research on the system 

The monitoring, unit should regularly pursue research on aspects of the 

systejn which are not directly related to policy problems or the need 
for accountability. Obvious budgetary constraints will require that 
the portion of independent funds reserved for this purpose be small. 
Much can be accomplished, however, by indirect methods: (a) helping 
other units of NIK to make use of their own research initiatives to 
provide by-product data; ( b) analyzing secondary sources external to 
NIE; and (c) payinr, for "piggy-back" data gathering where research 
carried on by oth^Ts ran be usefully expanded to include matters of 
interest to the ri^onirorinp, function (e.g. by approaching NSF for 
assistance).' 

The functions outlined above have major impUcations for operations, includine 

the followinp,: 

6 . Scope of Siudy 

The defieiti«on of the monitoring task should be broad: 

a. eM iicati^^nal f^ectors : The autiior is awar-^ Clint current >ME concerns 
,x:*> almost •.•;hn'l\ in the k-i2 sector with its extensions (primary 
cer ti f i catioe •••et. or), iiowever, monitoring should alfto include the 
Lask-orienr,<"i s'^r.ror (related to professiona"; and vocational activities) 
and t.he infntninl sector, though with limited expenditure of time an^i 
effort. Qot.h .jre likely to (Mnerf'.e in the near luture as areas of nuijor 
\)uh] i f; foncet n . 

b. definition oi Moniiorinp, shoulfl not be limited te a traditional, 
acadPmlr-orlont.ptl -onrepi of k.\D. It should include functions in the 
areas f-oth o! "distribution and exchange" and of "utilization." 
Howev'-^r, data fN-ithefing s^lOM)d include a definit ional framework 

siich that rh'^ Mwlitional RfA) areas can be comparfid directly with 
fip.ures provide <! Uy the NSF. 



149 



c. (lofinilion of "system" ; Ainhou^.h ir is usual to think of monitoriric 
the ]{^U system in terms of countinp, elements (institutions and people) 
in the infrastructurii and totalling dollars spent, the monitorinp. 
function should not bo limitPii to this sole task. Monitoring should 
also include thr other nrvas outlinrxJ in this paper, particularly 
ror.ulators and H^D throughput (activities) indicators. Due to the 
absence of reliable indicators for throughput and regulator systems, 
the study of the latter should probably proceed primarily on the basis 
of onG--time studies or the analysis of secondary sources, 
rather than by repeated measures of the same indicator over a 
period of years. 

Keportinfi framework 

Poor communications are a major stumbling block in the development of 
educational K&D. The Nit; should adopt a broad general, framework of 
report ini^ and retain it in all publications on the RS^D syste^i for a 
period of years. The specific framework proposed in this paper might 
serve the purpose, or some other could be used. However, it is important 
that, whatever framework is used for reporting,, its clarity and comprehensive- 
ness as a "bird's eye view" of the whole enterprise should not be any less 
than the proposed framework. The practical utility of a consistent communi- 
cations framework is enormous, provided that the framework meets the following 
conditions: 

a- Its formulation should be neutral, that is, acceptable to all publics of 
Nil::. This means that its formulation should not be tied to the most 
rrornmonly accept. ed models of K&D (e.g. dividing the spectrum of activities 
into research, development, dissemination, adoption, implementation). 
For larp.e parts of the e<jucational community and the general public, 
the applicability of these concepts is subject to debate, if not 
outright rejection; for parts of the scientific community, their validity 
as a description of how change occurs is subject to qualification or 
doubt . 

b. The formiilation should be broad enough to permit discussion wihin its 
bounds of different models of R&L) and social change, e.g. the 
discussion of the relative merits of a plaimed, R&D approach to change 
as opposed a grassroots, user-initi ated probl em-solving approach. 



c. The reporting model should clearly show, at a glance, all the niaj(ir 
interacting components of what is meant by an "K&iU system/* Only 
with considerable difficulty can the trained reader of literature on the 
H£.D system determine what portions of the over-all picture are being dealt 
with by a given writer* Such confusion cannot be tolerated in NIE 
publ ications • 
8. Kconomic studies 

Economics is not the only discipline base from which the study of H&D 

can be carried out* However, the nearly total nep.lcict of oconomic studios 

of educational K^l^ shoulfi not be allowed to pcrsi: t , Part icular impcjrrance 

should be attarh'.-d to studying the econoinic implictions of R&D for the 

t a s k - o r i on t < ' d s «^ • ci o r . 



- 1 ho pioposed rrportinp, model has one characteristic;. Graphi rally, di :-,Li nrtivc 
shapes arr:* jiiven to thf» elements; some similar system might be us^M as a 
"logos" in publ IcaLion.s , with t h<' por tion under discussion being identifiec} 
by a solid color, juch a visual Toferont would greatly facil i tai <• un^Jorstand Lng 
of Dubl icationr. . i 1 
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Table 1. Typical I ' ldicators for Monitoring the H&D Infrastructure 



I, Institutions 



2, Money 



3, Skilled persomel 



Regulators 



Secondary Infrastructure 



Primary Infrastructure 



1. Public institutions only 1. Institutions - all 

training institutions 
- selected equipment 
production units 

a, identity of institution, a. same 

type description 

b. general domain of action b, sae 



1. Institutions generally 



2, Money outputs (given 
avay), public institu- 
tions only 

a. quantities of money, 

financial period, to 
vhoffl 

b, policy goals rcb,ted to 

Eioney, recent changes 



a. same 

b. same 

c. "market" or consumer 
base served by insti- 
tution (market for 
producers, target or 
market for distributors, 
educational public for 
utilization sector) 



2. Money inputs (received) 2. Money inputs (received) 



a, same, except from vhoni a. sajiie as secondary 

infrastructure 



b, particularly noteworthy 
institutional goals 
and policies, if 
divergent from grantor 



b, same as secondarj^ 
infrastructure 



3, Personnel training system 3. Personnel employed 



a, types (age, qualifica- 

tions) of entei'ing 
persons, numbers 

b. types and range of 

training offered 



1, tj'pes (qualifications) 



of persons working 
function to which 
employed, numbers 
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c, te'iching personnel 

(niibers, qualifica- ' , 

tions, areas of 

teaching) 

d, types of persons leaving 

(age, level of addi- 
tional qualification 
received, area of 
specialization) , 
numbers 

, E^uip- and "on syste. ^. Ins^^^^^^^^^^^^^ 

facilities 

a. case descriptions of a. same, with reference 
selected equipment to types of equip- 

types produced ment installed 

(numbers , use, value) b. users of selected 

■ equipment types or 
public served 



* The extent of monitoring (i.e., level of aggregation of data gathered) viU be less intensive 
aa one progresses along the spectrum from creation/production to exchange/distribution to ^ 
utilization. 
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APPENDIX A 
An In forma tion-Agont: Interaction Model of 



Knt^wlodge Organization and Uti. i iza t ion 



The author faels it necessary to relegate to this appendix his own, 
entiruly pui'sonai view of how research and development fits into the world, 
of knowledge. Tliis view is so general as to be useless for any practical 
purpose; in addition the author has neither the depth or br' ndth of 
knowledge to undertake such a synthesis or to probe its implications. It 
is offered only as a footnote. The main body of the paper does not depend 
upon its consistency or accuracy, except as regards personal vision during 
writing. 

Over a decade ago Fritz Machlup published a book whose title has passed 
into the language; Production and Distribution of Knowledge in the 

United States (Machlup 1962). His book sketches a broad panorama of the 
sectors of American society for whicii information handling in various modes 
is the essential basis of activity. The phrase "production of knowledge" 
may have connt) t a t i nns which do not stand up to rigorous analysis, but it does 
accurately convoy Machlup *s concern for the economic aspects of information 
handling. The tiLh: is a good starting point for beginning; to develop a 
different imdursland ing of the content of K&D. 

Let us ho^;in by subslituiing the word "organization" for '')r - :V.ction" to 
give tile phase: "orz-^an i zatlon and utilization of knowledge.*' The change 
has utility, for it Lmmediately opens tlie door to a reconsideration of the 
stereotyped roles assigned in most motlels of F^&D to the researcher, the 
developer, the "linker," or th - user of R&D products. In addition it leaves 




A2.* 

aside the kernel problem of how knowledge comes into being, a problem best 
left to those who worry about matters such as the origin of the universe. 
Instead of looking at the ultimate origin of knowledge we shall focus upon 
the consequences, the ''output" of the creator of knowledge. For the moment, 
we can consider this creator to be a researcher. The conclusions derived 
from analysis of the researcher's activity can subsequently be generalized to 
other participants in the R&D process. 

The scientific researcher has as his objective a new structuring of 
some portion of the societal knowledge base of his time. Scientific 
hypotheses are stc- ments of relationships, the "structures" or "organizers," 
which he provides in terras comprehensible to fellow scientists. To borrow 
terminology from Popper (1964?), he provides conjectures, the refutations 
of which lead to new, "better" conjectures, the sum of vX.tsting unrefuted 
conjectures constituting at a given time that body of "knowledge" commonly 
called "science." In other words, each researcher adds to the sum of 
organized knowledge. In terms of content, he contributes what we might 
call "added organization of knowledge" similar to the "added value" contri- 
buted by the enterprise in the economy (cf. tax reform proposals to create a 
"tax on added valued"). His scientific activity constitutes an interaction 
between himself, the surrounding world and the societal knowledge base; at 
some instances that interaction may be personal reflection, at another, the 
d 1 of a series of empirical tests whose results he will confront with 
hx". jwn understanding of the knoT/ledge base, resulting either in njlormu- 
lation, or the confirmation, of a portion of it an added degree of 
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"organization of knowledge." 

At this point, the model of scientific activity has a certain abstract, 
logical simplicity. The human implications are less simpJe. No scientist 
can ever be said to "know" all of the societal knowledge base, not even those 
portions of it which were contributed by the formal processes of organized 
scientific research; the knowledge base in society is obviously greater than 
the knowledge accessible to a given individual, his personal knowledge 
base. The student of the behavior of researchers is aware of the degree of 

chance involved even in the best structured and planned environment 

in the process of scientific discovery. The term "heuristic" is used to 
describe our conception of how a person grapples with the infinity of 
possible sources of data to come up with a restricted set of those data 
capable of guiding his thought and action. The process of personal 
cognitive growth for the individual, researcher or not, can be equated v;ith 
the accretion of heuristics for symbol manipulation and for behavior; it is 
hardly likely that the path of the scientist in this regard is essentially 
different from that of the child: Popper's view of conjectures and refuta- 
tions in the scientific world is the exact analog, in fact the conscious 
refinement of, Piaget's view of cognitive development in the child (cf. 
Piagct 1972). The Interaction between societal knowledge base, personal 
knov;ledge base and personal activity is the process by which each individual 
adds to the store of knowledge. The neutral term for the principle 
governing this process is "feedback"; a highly controversial viewpoint on 
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the implications for education of manipulating the process is associated 
with the writings of B.F. Skinner. 

The personal knowledge base of each individual may be seen to consist 
of, at least, two components: a certain body of ideas deriving from the 
formal processes of "scientific research" (usually assimilated through 
indirect means, not by personal research) and a much larger knowledge base 
gathered informally through personal experience. This internalized know- 
ledge may be extended for a given practical use by accessing outside sources 
of knowledge (rumors carried by word of mouth, encyclopedias, microfilms of 
scientific treatises, etc.)* Human groups, as entities, have a knowledge 
base which is distinct from that of the individual but similarly composed 
of "scientifically" derived and informally derived components; the human 
group is, in essence, a storage medium for knowledge and group interactions 
(rituals of behavior, rules of hierarchy, administrative procedures, etc. , 
constitute an accessible form of knowledge which individuals draw upon to 
shape their actions). Assuming that there is a difference in immediate 
origin for these two classes of knowledge, we shall refer to them in the 
following as "scientific" and "non-scientific" knowledge, the reference 
being to the origin, not the content. 

The test of scientific knowledge is that persons other than the origi- 
nator of the knowledge be able to act apon it in the same way with the same 
results. In the physical sciences it is generally understood what is meant 
by "acting upon" scientific knowledge; when observed by different persons, 
the interaction of certain phenomena under defined conditions gives results 




predictable on the basis of the scientific knowledge. The meaning is less 
clear in the social sciences where th.2 difficulty of reproducing initial 
conditions (or, for the historian, defining what the initial conditions 
were) make this standard difficult to apply literally, thoug it is an 
acknowledged goal in most d i sti pi ines . In summary, ''added organization of 
knowledge" in the sciences is measured by the degree to which there is an 
increase in the ability of third parties to act upon organized knowledge 
with reliability. By this measure, the impact of Newtonian physics is 
clearly understandable in terms of its ability to guide human endeavor in 
multiple domains for centuries, until research on wave motion and atomic and 
sub-atomic physics demonstrated its insufficiency as an explanatory 
mechanism. 

The test of non-scientific knowledge is that persons other than the 
originator of the knowledge be able to act upon it in a consistent way 

vith in their understanding the same results. This process differs 

from the scientific validation process in terms of the much broader limits 
assigned to the human understanding. The scientist's task is to limit the 
free play of indivlflual understanding by defining conditions so that, in 
theory, all men will derive the same results under tlie same conditions 
concerning the phenomenon being considered. The measure of "added organi- 
zation of knowledge'Vis exactly tlie same for non-sc icMi t i f ic knowledge, the 
degree to which the addition increases the ability of others to act upon 
the knowledge base with perceived reliability, the assessment of reliability 
heinji more depondent upon the judgement of the individual observer. This 
"measure" has the characteristic of reducing to a common dimension the 
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impact of the idcMs of a Muhamc!: r.'ui n Newton. 

The relationship of these iwo types of knovlodge to research and 
development activities may be understood by returning to our prototype 
scientist or re.rearcher . Except for narrowly detined domains of speciali- 
zation, scientists guide Ll:e:lr behavi «r on the basis of non-scientific 
knowledge, knowledge imbeded in every word they say, in very social custom 
they observe or choose to flout. Behavior guided by rules derived from 
science is an exception, even for scientists. The modern technology 
called '*R&D" has been concerned with how to use, or organize the use of, 
this narrow swath of scientific knowledge. The main applications of R&D 
which have proved successful are in the production of physical items — 
the development of, say, telephone networks C^h^ term "system engineering" 



was first used in Bell Laboratories (Hall I964jj , weaponry and the 
physical impedimenta of our consumer society. Success in other domains 
has been inversely proportional to the degree to which the object of the 
process was a shift in behavior of human groups. Medical research, for 
example, has given us techniques which control viruses, but few which change 
the collective behavior of doctors, patients, or politicians; the richest 
country in the world makes access to health care dependent upon the hazards 
of personal birth and wealth. Asking "medical R&D" to change this situation 
is analogous to asking "educational R&D" to overcome the cognitive disadvan- 
tages produced in children by living in a ghetto. It is symptomatic that 
few consider it the business of medical R&D to reshape the delivery of 
medical services but there is general agreement that educational R&D can 
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provide something called "compensatory education." The perceived success 
or failure of these two branches of R&I) is dependent upon the degree to 
which their assigned goals involve a change in human behavior on a large 
scale. In laboratory situations methuds exist to assist the disadvantaged 
child, methods which, to be truly successful, would require that the "treated" 
child be nurtured thereafter in a non-disadvantaged environment. This 
cannDt hv. practiced on a broad scale without massive changes in the 
structure uf both his society and his schools, changes whicli presently are 
both beyond the scope of educational R&D and of education. 

Let us accept as given that the goals now assigned to educational R^D 
are goals involving sociaJ. change on a broad scale. Uhat does this mean 
with regard to the two types of knowledge referred to above? There has 
been an assumption present, both in the literature on R&D and in its practice 
at all levels, that the problem of social change can be equated with the 
problem of how to make sure that scientific knowledge is utilized in educa- 
tional practice. This assumption deserves to be questioned in a funda- 
mental way (cf. Thayer 1973). ' To begin with, if the educational system is 
conceived of as a social system, then it is evident tliat the thing called 
educational "practice," the aggregate behavior pattern of all persons 
invoJved in tlie system, is founded primarily upon non-scientific knowledge 
sources. Even great success in "translating scientific knowledge into 
practice" will not alter more than a small proportion of this aggregate. 
Major changes, sucii as radical decisions to redefine societal goals for 
education or to restructure the educational system, are Likely to be made 
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in response to knowledge which is hardly scientif*': in origin and through 
processes which arc* certain to be unsystematic. This implies that one is 
faced with a choice: Defining educntional H&D l:<^ nu'.in the translation of 
scientific knowledge into practice Is to place i^c.vcrc limits on the changes 
which can be effected; on the other hand, if one says that major changes 
must occur and they must be derived from the scientific knowledge base, 
then one is assuming the suppression of non-scientific knowledge forms as 
a root of social behavior, something which is manifestly not possible in 
parctice. The alternative is to give up the equation between R&D and 
scientific knowledge, perhaps assigning as a goal the use of as much 
scientific knowledge as possible in the process but recognizing the limits 
upon its use. 

If one gives up the fixation upon scientific knowledge>it is possible 
to perceive the whole R&D process in a different light. Lcoking along the 
spectrum of activities assumed to separate research findings from utiliza- 
tion in practice in certain models of R&D (research, development, dissemina- 
tion, adoption and implementation, or something of the like), one discovers 
a rtipetitive pattern of interactions between agents and the societal know- 
ledge base. The scientist's specialized role in life is to make contri- 
butions to the "added organization" of scientific knowledge, a process which 
combines heuristic probes with rigorous methodology for testing validity of 
hypotheses; the developer combines some scientific knowledge with (if he is 
to be successful) iTiUch inspiration and common sense to produce a developed 
product; the "linkage agent" draws upon, for example, objective evaluation 
data on an educational product and combines it with his personal knowledge 
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of people and situations to asKif;t the practitioner to use the product or 
docido not 10 use U on some riMSoued grounds; the practitioner decides 
to adopt the product and appLii-s it in his individual circumstances in the 

light of objective, verifiable information and much intuition the same 

intuition which gets him promotions, avoids personal embrassment in social 
situations and decides when disciplinary action is called for on the play- 
ground. Upon analysis, each person along this line combines large measures 
of intuition with verifiable objective knowledge to meet certain goals. 
The goals differ and the required training for each role differs, but the 
essential process bears a remarkable resemblance, so close that it becomes 
difficult to distinguish one phase from the previous. 

No difference between a teacher and a scientist? Certainly they differ 
in terms of the content of the transaction and as regards the refinement of 
the methodology, buc definitely the over-all structure of the process is the 
same. The "successful" classroom teacher's behavior is rewarded by 
innumerable happenings in his environment (reinforced, Skinner would have 
us say), resulting in a cumulative pattern of behavior which is a form of 
empirically- based but non-scientific knowledge. The teacher's innovations 
and impr -'ns — they may be no more than how to organize an ill- 
designed cloakroom characteristic of a particular school building are 

a communicable fon-n of knowledge. The complex behavior pattern by which 
the teacher develops a knowledge of his trade bears a strong resemblance 
to the complex behavior of the trained researcher. • .probing, improvising, 
testing. The process may be carried out without the researcher's level 
of self-awareness, but it occurs all the same. Insofar as the outcomes 
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are usable by others with reliability of results, some added organization 
of knowledge has occurred. 

An objection may be raised that scientifically demonstrated knowledge 
is universal in its application and, therefore, is endowed with different 
properties from non-scientific knowledge. From this it would follow that 
we are dealing with a different entity and, thus, with a different process. 
This is to ignore two fundamental issues: (1) The first has been referred 
to earlier. Since the overthrow of Newtonian physics as the ultimate 
explanatory system of the physical universe, it is hardly possible to 
speak in any rigorous way of scientific "laws"; such laws must forever be 
ringed with a tinge of doubt and should be considered hypotheses for which 
no counter-proof has been found. The knowledge we have called "non- 
scientific" is distinguished only by the ease with which counter-examples 
or refutation are usually found. (2) Human behavior is not mecessarily 
changeable by rational processes. Cigarette smoking continues to progress 
despite "proof" of its dangers to human life. In education, conventional 
wisdom may have done away with the cat-o 'nine-tails and most other crude 
forms of physical punishment, but it clings obstinately to a multitude of 
corollaries of "spare the rod and spoil the child." These two fundamental 
issues the uncertainty of scientific knowledge itself and the "non- 
rational" origins of humaq behavior cloud the distinction between our 

categories of "scientific" and "non-scientific" knowledge. There is a common 
sense vigor to the distinction between them when referring to the physical 
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sciences the solid wood tnblc rocognized by non-scientific knowledge 

is clearly difrorunt: frDui i lu* i-o 1 ! I'ci ion of mo.lecuI(\s divided into atoms 
and so on that scientific knowledge' has given us. Hut in the field of 
social sciences the clear division fades and is replaced by a shifting, 
easily penetrated barrier. It is difficult to adduce a difference in 
**kind" of knowledge which, in turn, would allow us to show that there is a 
fundamental difference in the process by which each is created. 

The brunt of our last argument has been to efface the difference in 
"kind" assumed to separate the different roles of persons in the chain from 
research to utilization. In fact, the arguments have been brought forward 
to show that the existence of such a presumed linear sequence is the excep- 
tion rather than the rule. If one accepts that the different agents 

referred to researchers, developers, etc. may have differing goals 

(related in some fashion to their different individual knowledge bases), it 
follows that the sequence by whicli "knowledge is traoslated into practice" 
occurs at each />oint along the spectrum and can occur without reference 
to any other point in the lines: researchers can pursue their interests 
without reference to applications, developers can develop products without 
an application, linkage median isms can deliver information which is not 
used, practitioners can ignore the mandates of science and instead imitate 
" tr.^d:l tional methods of teaching, etc. Conversely, links along the' chain 
can occur fortuitously or, good management practices (perhaps called ^'R&D") 
can raise their probability of occurrence well above the thresliold of pure 
chance . 
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Rather than visualize "R&D" as a linear sequence of translation 
of scientific knowledge into practice, we can use the agent-information 
interaction sequence to visualize something on a more molecular level: 
An infinity of agent-information interactions occurring continuously along 
a spectrum which, at the research end, has very few molecules and, at 
the practice end, has a great bulk of molecules. Unlike the world of gaseous 
diffusion, human society is not dependent upon random encounters. The 
thing called "R&D" can be equated neither with random diffusion nor with 
some simple mechanistic process by which an idea issuing from research is 
shot like an arrow in the direction of "practice," where it makes an 
"impact/' but rather with a sort of catalyst which, at any point in the 
chain, facilitates the agent-information interaction process. This may 
mean, in concrete terms, improving the "atmosphere" in which pure research 
occurs or facilitating rational problem-solving in a junior high school; if 
knowledge, whether "scientific" or "non-scientific", is that which 
resists the test of practice and application, then this facilitating func- 
tion will, by definition, increase the speed with which the scientifically 
verified "idea" will reach practice. Those with a taste for viewing the 
world as an entity to be managed will derive an operational definition of 
R&D as the technique of managing the information-agent interaction; for those 
who think that "structure" or "establishment" is the major obstacle to human 
progress, this view can provide a charter for liberation, to "free" the 
molecules the human beings to interact and develop their experience 
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base; those who believe in the power ideas will see this as a simplistic 
view oT the way in whi«'h an ide;] c'ln iransform society. 

There is no way of saying if one is right, or ail are. For this 
analysis of R&l) has led us to equate it with an objective, not with a 
definable thing or a specific technique, and certainly riot the specific 
methodology which gave us the Apollo moonshots or the Mustang II. The 
objective is to facilitate R&D, spelled ouf as research of knowledge and 
development of whatever it is that human beings, in the light of their 
knowledge, fix as their goal. The definition is thus recursive: The 
objective is to use search for knowledge as a means of attaining objectives 
defined in terms of the knowledge that one is continually searchin, to add 
to. One feels that, somehow, that is the way it should be defined. 



For those .;ho seek to formalize models, the following notes indicate 

the main elements to be included in a formal statement of the agent-iufor- 

matif'U interaction model: 

• -^1 2 n ^S^^ts, that is humans either as individuals or 

' collectivities 

2. - The societal knowledge base 

3, Ka - The portion of the societal knowledge base accessible 



at a given time to a given agent (A^) 
- Knowledge "loss" such that, between times t\ and ty- 

h- yti,+t2= h 
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- y analyzes into two components: ^ 

y^ ~ an intrinsic loss deriving from the nature of 
the way the knowledge is stored, an entropy 
familiar to the analyst of information systems 
(including in the case of the societal know- 
ledge base outright disappearance of infoxnna- 
tion resulting from the physical disappearance 
of the storage medium) 

y^ - a loss deriving from the particular character- 
ristics of a given agent involved in access- 
ing the societal knowledge base; that is, we 
are dealing with an index of the "inefficiency" 
of the agent (or the means at his disposal) as 
an access mechanism. 

y. and y are not necessarily independent. 



5. Oj^ - Added organization of knowledge such that, between 

time periods t-i and to (ignoring loss y. *. )* 

1' 2 

where the specific content of the operator * depends 
upon the nature of Oj^r logical union for the 
simple addition of new data would be rare, the most 
common operation involving a complex set of specifi- 
cations of relations between previous knowledge 
and the "new'' knowledge, some of them implying the 
negation or disappearance of previous knowledge. 

~ It follows that, introducing loss: 

^l (t^) " • yti,t2 

6. The societal knowledge base is necessarily defined in terms of a 
given society. There are two possible procedures for defining 
this: 

6a. The "society" may be defined as a set of agents -^A^, A^,...A^'^. 

These agents could then be viewed as sharing exactly equivalent 
status as regards their contributions to the knowledge base such 
that for the given society would be the logical union of all 

accessible knowledge for the set of agents. Or, without equivalent 
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status, oacli ciMilil ri>nUlhu!i» somi* propur 1 !(?n i: f ilU .U'cj^mm f li 1 1- 
knowledge, im)iiiru»,l l>v a loss l:uLor: . y 

n 

6b. Conversely, a "society" may be defined in terms of the extent to 
which knowledge is shared between agents. One might visualize 
a universe of agents as nodes in a communication network. Taking 
any one node a.s a base, one can Tiove "outward" in the network 
until one reaches the outermost nodes from which additions to the 
base of knowledge accessible to the first node cease to be possible 
within a defined, finite time span. All nodes capable of making 
contributions to that central node's base of accessible knowledge 
constitute the "society" of that node. The transmission along 
the network would result in information losses of "he type defined 
above (y^) • 

(This definition of a "society" is analogous to the concept of 
a gene pool operating for a given species or the molecular theory 
of natural language development and diversification over a large 
geographic area. It does not imply, however, that communication 
of knowledge occurs solely through interpersonal contact between 
agents; such communication in the network could be mediated via 
other mechanisms) . 

7. The relationship berveen added organization of knowledge and the 
concept of information content elaborated in modern communications 
theory deserves to be explored. The fundamental definition of 
information revolves around the concept of novelty, a message having 
a predictable content would lack novelty and thereby "information 
content." In terms of a knowledge base conceived of as a set of 
interrelated, partially consistent hypotheses, an entirely 
contradictory hypotheses refuting the basis of most of the existing 
hypotheses (.such as the concept that time if "relative" in the 
physical world) would appear to have a high novelty value,- but as 
in the case of a "wild idea" would not necessarily be an addition 
to the knowledge base. In this light, added organization of 
knowledge would appear to involve establishment of relationships 
between previous knowledge and new information; the importance of 
the addition would presumably be proportionate to the degree to 
which the nev; information appeared unpredictable on the basis of 
previous knowledge. In other words, it would be directly 
proportional to the information content of the integrated information. 
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3. Secondary infrastructure 

a. Specialized personnel training system (highly qualified 
research, development, dissemination personnel) 

1) Institutional base and -^rograu 

2) Personnel 

b. Development of speciali:: iment for use in R&D 

4. Regulators: trends in policy ading (mainly Federal), 
implications 

a. Institutions 

1) Problems of continuity for institutionax v^elopment 
Creation of NIE and its implications 

•ireer continuity and recruitment 

2) Shortages and oversupplies , sectoral distortions 

Operations 

2^ Introduction / ^ ^ 

a* Types of indicators: activity levels for functions (R,D,D, &c.), 

products and outcomes for throughput 
b Problem of discontinuity between different portions or system 
(production/creation not necessarily related to distribution/ 
exchange, which does not necessarily result in utilization ^c.) 
c* Leading to grouping of indicators separately 
2. Intermediate indicators of system operations 

a. Creation/production ) (function activity level 

b. Distribution/exchange) ' (product & outcome througnput 

c. Utilization ) 

1) Problems of measuring impact and utilization 

a) Problems of measuring impact of one factor an:ong many 

b) Question of relative size of investment in RiD anc 
planned innovation compared to size of total 
operating system 

c) Need for data on the operating system as a framework 
for understanding utilization data 

2) The public for educational research, development, and 
planned innovation 

3) Tr«:nds of educational change 

4) Indicators for the operating educational system 

5) Indicators of RLD utiJ.ization 

6) The unresolved issues: 

a) Quality 

b) Productivity 

c) Separat-^on of system impact from product utilization 
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research, development, dissemination personnel) 

1) Institutional base and programs 

2) Personnel . 
b Development of specialized equipment for use 
R;gulators: trends in policy and funding (maxnly Federal), 
Implications 

irlroriem: of continuity for institutional development 
2) Creation of NIE and its implications 

b. Personnel 

1) Career continuity and recruitment 

2) Shortages and oversupplies , sectoral distortions 



erations 



T"°^llTf indicators: activity levels for functions (R.D.D. Sc.). 

c Leading to grouping of indicators separately 

TnfPnnediate indicators of system operations 

i!''S:a"on/ptoa„ctlon , , <^ \Z%.,.. 
h. Distribution/exchange) ^proauct 

* of measuring impact and ^tilj-tion 

a) Problems of measuring impact or ^^'^^^f °^ ^ 
Question of relative size of :Lnvestment in R&D 
planned innovation compared to size of total 

redlfr^dftr:: the operating system as a framework 
for understanding utilization data _ 
Tne public for educational research, development, and 



a) 
b) 



c) 



2) 

planned innovation 
•^■i Trends of educational change 

4) Indicators for t a operating educational system 

5) Indicators of R&D utilization 

6) The unresolved issues: 
a) Quality 

% llllT:tZ'lf system i.pact fto„ proauct .tilization 
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Regulators (for throughput) 



a:"ReguS"" affecting operations (not mrrastruoture) 

included here , . 

h. Generality of concept of regulators, limted scope of 

this su .rnary 

? Market forces and governmental intervention i^^^j 
^concepts of supply and demand, i.p.rfect ..rket, regulated 

market, narket intervention and subsidization ^^Mvity 
b. Direct intervention: sponsorship and subsidization of activity 

1) The Federal role 

a) Decision-making structures and processes ot 
major federal ai?,encies 

b) Description of r.aior sponsors and programs 

2) Other sponsors (foundations) 

c Indirect intervention: the manipulation of incenrives 

1) Creation and production: direct cuppoi. 

2) Distribution and exchange: copyright, public ca7.r ers 
regulation, etc. 

3) Utilization: subsidization, advocacy 
3, The legal and adminir :rative framework 



a. 



Statutory law, regulations, ordinances . .„ . 

1) Federal: e.g., forms clearance, huran subject^ at rl.K 



1) Federal: e.g., forr.s clearance, tiuran ^""J ^'^^^ _ 
2 State and local: e.g., access to schools ror R&D purposes 
b. Sv.^tems and policies of public educat.:-oa agencies 

rSDGcial reference to: planning for chc.nge.,. .■.:.ap - ° _ ^, 

Elementing R^D outputs, participation patterns in process 
planning, deciding and implementing changes. J 
Lnagenent techniques for RSD, planned innovation 



c. PianaKt;..icui. . ^ 

1) I-Iaior funding sources (par u cuiari/ 

2) Program and project managemenc (selected .nstitut.on.) 

f ^ 5if;ublic:1Sl and issues of public opinion on ed.ca.l 
b! The professional: evolving roles, attitude, -.nd st^^.us ... 

^|;ryf'?h''agenda:°needs or demands, child or con.^or.er? 



r The yo 'th agenda; ne^uts ul ucul^.^v.^, . ^ 

d. The future of education: projections, prcdi. tic;:-s , u^oplo. 



laformation on the system 

1. Selected references and sourcer of data 

2. Research on the RSD system 
a. Models and proposals 

h. Major research in progress 
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